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NASA  STI  Program  ...  in  Profile 
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Reports  Server,  thus  providing  one  of  the  largest 
collections  of  aeronautical  and  space  science  STI  in 
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and  extent  of  graphic  presentations. 

• TECHNICAL  MEMORANDUM.  Scientific 
and  technical  findings  that  are  preliminary  or  of 
specialized  interest,  e.g.,  quick  release  reports, 
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minimal  annotation.  Does  not  contain  extensive 
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• CONTRACTOR  REPORT.  Scientific  and 
technical  findings  by  NASA-sponsored 
contractors  and  grantees. 


• CONFERENCE  PUBLICATION. 

Collected  papers  from  scientific  and 
technical  conferences,  symposia,  seminars, 
or  other  meetings  sponsored  or 
co-sponsored  by  NASA. 

• SPECIAL  PUBLICATION.  Scientific, 
technical,  or  historical  information  from 
NASA  programs,  projects,  and  missions, 
often  concerned  with  subjects  having 
substantial  public  interest. 

• TECHNICAL  TRANSLATION. 
English-language  translations  of  foreign 
scientific  and  technical  material  pertinent  to 
NASA’s  mission. 

Specialized  services  also  include  organizing 
and  publishing  research  results,  distributing 
specialized  research  announcements  and  feeds, 
providing  information  desk  and  personal  search 
support,  and  enabling  data  exchange  services. 

For  more  information  about  the  NASA  STI 
program,  see  the  following: 

• Access  the  NASA  STI  program  home  page 
at  http://www.sti.nasa.sov 
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A Nomenclature 

A.l  Symbology 

A Gravitational  acceleration  vector 

a p Three-hour-interval  geomagnetic  activity  index 

B Inertial-to-body  transformation  matrix 

b Reference  wingspan 

C Aerodynamic  coefficient 

Cnm  Normalized,  unit-less  gravitation  coefficient  of  degree  n and  order  m 
c Mean  aerodynamic  chord 

D Drag 

d Differential  operator 

F Force 

F-jo  7 Daily  10.7  cm  solar  flux 
Fio.7  Six-solar-rotation  mean  10.7  cm  solar  flux 

G Gravity  gradient  matrix 

G Universal  gravitational  constant 

g Unit  of  acceleration 

H Second  derivative  of  U with  respect  to  ECEF  coordinates 

h Geometric  altitude 

I Inertia  tensor 

I Moment  or  product  of  inertia 

Is p Specific  fuel  consumption 

J2  Second  degree  zonal  harmonic  coefficient  of  gravitation 

M RNP  matrix  to  transform  ECI  into  ECEF  coordinates 
M Mass  of  the  Earth 

m Mass  or  gravitational  model  order 

n Gravitational  model  degree 

O “Order  of”  operator 

P Intersection  of  Prime  Meridian  and  Equator,  or  arbitrary  vehicle  location 

Pn,m  Normalized  associated  Legendre  function  of  degree  n and  order  m 
p Roll  rate 

q Pitch  rate 

R Inertial  position  vector 

R Radius 

r Yaw  rate,  or  radius 

T2  Radius  of  spherical  Earth  of  equal  surface  area  as  reference  ellipsoid 

re  Equatorial  radius  of  the  Earth 

rp  Polar  radius  of  the  Earth 

S Reference  area 

Snm  Normalized,  unit-less  gravitation  coefficient  of  degree  n and  order  m 

s Intersection  of  Earth’s  surface  of  radius  vector  to  arbitrary  point  P 

T Torque 

t Time 

U Potential  function 

Ub  Atmosphere-relative  velocity  component  along  the  body  cc-axis 

Vb  Atmosphere-relative  velocity  component  along  the  body  y-axis 
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Wb  Atmosphere-relative  velocity  component  along  the  body  z-axis 

X Earth-centered  inertial  axis  from  Earth  center  through  Equator/Prime  Meridian  (lat.  0,  long.  0) 

intersection  at  t = 0 (for  atmospheric  check-cases);  axis  aligned  with  the  mean  equinox 
at  epoch  J2000  (for  orbital  check-cases) 

X Earth-centered,  Earth-fixed  axis  from  Earth  center  through 

Equator/Prime  Meridian  (latitude  0,  longitude  0)  intersection 
x Location  of  center  of  mass  along  body  x-axis 

x Inertial  position  coordinate  along  the  inertial  X-axis 

x Body  longitudinal  axis,  -|-forward 

Y Earth-centered  inertial  axis  from  Earth  center  forming  a right-hand-rule 
with  X and  Z 

Y Earth-centered,  Earth-fixed  axis  forming  a right  hand  rule  with  X and  Z 

y Location  of  center  of  mass  along  body  y-axis 

y Inertial  position  coordinate  along  the  inertial  Y-axis 

y Body  lateral  axis,  -bright  to  an  observer  facing  in  positive  x direction 

Z Earth-centered  inertial  axis  from  Earth  center  through  North  Pole 

Z Earth-centered,  Earth-fixed  axis  from  Earth  center  through  the  North  Pole,  or  geopotential  height 

z Location  of  center  of  mass  along  body  z-axis 

z Inertial  position  coordinate  along  the  inertial  Z-axis 

z Body  vertical  axis,  +down 

a Angle  of  attack,  projected  into  the  body  x-z  plane 

atotai  Unconstrained  angle  of  attack 
/3  Ballistic  coefficient  or  angle  of  sideslip 

V Velocity 

6ij  Kronecker  delta 

e Eccentricity  figure  of  the  Earth 

9 Pitch  attitude 

A Longitude 

p Gravitational  parameter  (product  of  GM) 

V Normal  vector  to  the  surface  of  the  Earth 

v Projection  of  V on  the  Equatorial  plane  of  the  Earth 

p Moment  arm  of  differential  element  of  mass 

t Gravity  gradient  torque 

<f>  Bank  angle,  or  geodetic  latitude 

ip  Heading  angle 

w Earth’s  mean  rotation  rate 

Subscript 

cm  Center  of  mass 

1 Body  1 

2 Body  2 

b body  of  vehicle 

D Drag  component 

L Lift  component 

l Rolling  component 

in  Pitching  component 

n Yawing  component 

s Surface  of  the  Earth 
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T True  airspeed 

xx  Moment  of  inertia  around  the  body  x-axis 

yy  Moment  of  inertia  around  the  body  y-axis 

Y Sideforce  component 

zz  Moment  of  inertia  around  the  z axis 

xy  Cross-product  of  inertia  in  the  body  x-y  plane 

yz  Cross-product  of  inertia  in  the  body  y-z  plane 

zx  Cross-product  of  inertia  in  the  body  z-x  plane 

Math  symbols 

d Mean  or  average  value  of  o 

6 Time  rate-of-change  of  o 

d Time  rate-of-acceleration  of  o 

\E\  Absolute  value  of  E or  scalar  magnitude  of  E 

E 3-dimensional  vector  whose  magnitude,  \E\,  is  E 

A E Change  in  E 

'S/E  Gradient  of  E 


A. 2 Acronyms 


2D 

AFRC 

ANL 

ANR 

ANU 

ARI 

CM 

CWFN 

DAVE-ML 

DCM 

DOF 

DUT1 

ECEF 

ECI 

EOM 

FORTRAN 

GEM-T1 

GNC 

IC 

IDL 

IERS 

ITRF 

ISS 

J2000 

JEOD 

JSBSim 

JSC 


Two-dimensional 

Armstrong  Flight  Research  Center 

Aircraft  nose  left 

Aircraft  nose  right 

Aircraft  nose  up 

Aileron-to-rudder  interconnect 

Center  of  Mass 

Clockwise  from  North 

Dynamic  Aerospace  Vehicle  Exchange  Markup  Language 
Direction  cosine  matrix 
Degrees-of- freedom 

Difference  between  Universal  Time  and  Coordinated  Universal  Time,  seconds 
Earth-centered,  Earth-fixed  (rotating  coordinate  frame) 

Earth-centered  Inertial  (non-rotating  coordinate  frame) 

Equations  of  Motion 
FORmula  TRANslator 
Goddard  Earth  Model  T1 
Guidance,  Navigation  and  Control 
Initial  Condition 
International  Date  Line 

International  Earth  Rotation  and  Reference  System  Service 

International  Terrestrial  Reference  Frame 

International  Space  Station 

Earth-centered  Inertial  Frame  for  Epoch  2000 

JSC  Engineering  Orbital  Dynamics 

Open-source,  data-driven,  simulation  framework  in  C++ 

Johnson  Space  Center 
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KEAS 

kt 

KTAS 

LaRC 

LaSRS++ 

LQR 

LRC 

LVLH 

LWD 

MAC 

MAVERIC 

MAX 

MET 

MET95 

MET99 

MET07 

MIL 

MRC 

MSFC 

MSIS 

MSL 

N.A. 

NED 

NESC 

PLA 

PM 

POST  II 

RNP 

RWD 

S-119 

SAS 

SIM 

SRB 

TED 

TEL 

TFrames 

VMSRTE 

WGS-84 

XML 


Knots  Equivalent  Airspeed 
knots  (nautical  miles  per  hour) 

Knots  True  Airspeed 
Langley  Research  Center 

Langley  Standard  Real-time  Simulation  in  C++ 

Linear  Quadratic  Regulator 

Local  Reference  Coordinates 

Local  Vertical,  Local  Horizontal 

Left  Wing  Down 

Mean  Aerodynamic  Chord 

Marshall  Aerospace  Vehicle  Representation  in  C 

Maximum  thrust  level 

Marshall  Engineering  Thermosphere 

Marshall  Engineering  Thermosphere,  (1995  version) 

Marshall  Engineering  Thermosphere,  (1999  version) 

Marshall  Engineering  Thermosphere  (2007  version) 

Military  (maximum  unaugmented,  non-afterburning)  thrust  level 

Moment  Reference  Center 

Marshall  Space  Flight  Center 

Mass  Spectrometer  Incoherent  Scatter 

Mean  Sea  Level 

Not  Applicable 

North-East-Down 

NASA  Engineering  and  Safety  Center 
Power  Lever  Angle 
Prime  Meridian 

Program  to  Optimize  Simulated  Trajectories  II 

Rotation-Nutation-Precession 

Right  Wing  Down 

ANSI/AIAA  S-119-2011  Flight  Dynamic  Model  Exchange  Standard 
Stability  Augmentation  System 

Label  used  for  comparison  plots  for  anonymized  simulation  tool  results 
Solid  Rocket  Booster 
Trailing  Edge  Down 
Trailing  Edge  Left 

Tools  to  Facilitate  the  Rapid  Assembly  of  Missile  Engagement  Simulations 
Vertical  Motion  Simulator  Real-Time  Environment 
World  Geodetic  System  1984 
extensible  Markup  Language 


B Models 

B.l  Vehicle  models 

A set  of  reference  vehicles  was  proposed  based  mostly  on  existing  non-proprietary  vehicle  models.  An 
overview  of  each  model  is  given  below.  These  models  are  available  from  http://nescacademy.nasa.gov/ 
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f lightsim/index . html. 

For  the  quiescent  (non-maneuvering)  orbital  scenarios,  we  only  need  consider  two  characteristics  of  the 
orbiting  vehicle:  inertial  properties  and  drag  characteristics. 


Inertial  properties  The  mass  of  an  orbiting  vehicle  determines  its  response  to  outside  forces  and  torques. 
The  mass  properties  of  a satellite  are  captured  by 


• Total  mass 


where  m is  the  total  mass,  b is  the  body  of  the  vehicle,  and  dm  represents  a differential  unit  of 
mass. 

• Center  of  mass  (CM) 


where  dm  represents  a differential  element  of  mass  located  at  the  point  ( x , y,  z)  and  the  integration 
is  performed  over  the  volume  of  the  vehicle. 


• Inertia  tensor 


and 


where 


I = 


b xx  Ixy  b :r  z 


-J. 


xy 


Lyy 


^xz  dyz 


Ixx. 


lyy  ~ 


J-zz  — 


Ixy  ~ 


/ ( P2y+Pl)dm 

Jb 

/ (Pi  + Pl)dm 
Jb 

/ {Pi  + Pl)dm 

Jb 


pxpvdm 


Ixz  = / PxPzdm 


lyz  — 


pypzdm 


P = 


Px 

Py 

Pz 


x — X 

y-y 

z — z 


(3) 


(4) 

(5) 


Drag  characteristics  In  general,  the  characterization  of  forces  and  moments  exerted  as  the  vehicle  moves 
through  a medium  can  be  quite  complex;  however,  for  the  purposes  of  comparing  orbital  trajectories, 
a simple  ballistic  coefficient  model  will  suffice. 
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Given  the  definition  of  ballistic  drag  coefficient,  /3d,  as 

R _ m 

Pd~c^s 

and  substituting  Cd  into  the  equation  for  aerodynamic  drag 

D = l-pVT2SCD 

an  equivalent  expression,  given  the  ballistic  drag  coefficient  /3d,  is 

D _ pVt2/3d 
m 


(6) 

(7) 

(8) 


For  the  atmospheric  scenarios,  the  aerodynamic  models  are  typically  non-linear  and  table-based,  and  propul- 
sion models  (if  included)  are  affected  by  vehicle  airspeed.  The  same  mass  property  definitions  given  previously 
still  apply. 


B.1.1  Spheroid  - atmospheric  check-cases 

The  simplest  model  used  in  generating  a representative  aerodynamic-flight  reference  trajectories  was  a sphere 
of  fixed  size,  inertia,  and  a constant  drag  coefficient,  as  given  in  Tables  1 and  2.  These  are  somewhat  arbitrary 
values. 

Table  1.  Atmospheric  Spheroid  Mass  and  Inertial  Table  2.  Atmospheric  Spheroid  Aerodynamic 

Characteristics  Characteristics 


Parameter  Value8, 


Ixx 

3.6  slug-ft2 

lyy 

3.6  slug-ft2 

1-zz 

3.6  slug-ft2 

Ixy 

0.0  slug-ft2 

lyz 

0.0  slug-ft2 

Izx 

0.0  slug-ft2 

m 

1.0  slug 

X 

0.0  ft 

y 

0.0  ft 

Z 

0.0  ft 

8 measured  from  the  CM 


Parameter 

Value 

S 

0.1963495  ft2 

cL 

0.0 

CD 

0.1 

Cy 

0.0 

Ci 

0.0 

cm 

0.0 

Cn 

0.0 

B.1.2  Spheroid  - orbital  check-cases 

A different  spheroid  with  metric  units  was  used  in  generating  the  orbital  reference  trajectories.  It  had  fixed 
size  and  inertia  as  given  in  Table  3.  This  model  was  reused  from  the  earlier  orbital  simulation  comparison 
study  [1]  and  had  a radius  of  1/ y/n  m. 
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Table  3.  Orbital  Spheroid  Mass  and  Inertial  Characteristics 


Parameter 

Value 

1-xx 

2/(5tt)  kg-m2 

lyy 

2/(57 r)  kg-m2 

Izz 

2/(57t)  kg-m2 

Ixy 

0.0  kg-m2 

lyz 

0.0  kg-m2 

Izx 

0.0  kg-m2 

m 

1.0  kg 

X 

0.0  m 

y 

0.0  m 

Z 

0.0  m 

B.1.3  Brick 

The  next-simplest  model  evaluated  was  a brick-shaped  object  with  rotational  aerodynamic  damping,  as  given 
in  Tables  4 and  5.  No  attempt  was  made  to  ascertain  the  actual  parameters;  these  inertia  properties  were 
estimated  assuming  homogeneity  while  the  assumed  aerodynamic  characteristics  were  completely  arbitrary. 
The  moments  and  products  of  inertia  were  given  about  axes  that  originate  at  the  CM. 

The  brick  was  assumed  to  be  standard  size:  8 inches  by  4 inches  by  2.25  inches,  corresponding  to  the  x,  y, 
and  3 body  axes  dimensions  as  shown  in  Figure  1. 

Table  4.  Estimated  U.S.  Standard  Face  Brick  Table  5.  Fictitious  U.S.  Standard  Face  Brick 

Mass  and  Inertial  Characteristics  Aerodynamic  Characteristics 


Parameter 

Value 

Parameter 

Value 

%xx 

0.001894220  slug-ft2 

S 

0.22222  ft2 

lyy 

0.006211019  slug-ft2 

b 

0.33333  ft 

Izz 

0.007194665  slug-ft2 

C 

0.66667  ft 

Ixy 

0.0  slug-ft2 

CL 

0.0 

lyz 

0.0  slug-ft2 

Cd 

0.01 

^zx 

0.0  slug-ft2 

Cy 

0.0 

m 

0.155404754  slug 

Ci 

0.0 

X 

0.0  ft 

Cm 

0.0 

y 

0.0  ft 

Cn 

0.0 

Z 

0.0  ft 

Cip 

-1.0 

ctr 

0.0 

Cmq 

-1.0 

Cnp 

0.0 

cnr 

-1.0 
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Figure  1.  U.S.  Standard  Face  Brick 


B.1.4  Cylinder 

A uniform-density  cylinder  of  size  12  m x 1 m x 1 m,  used  for  certain  orbital  check-cases,  also  was  reused 
from  the  earlier  orbital  simulation  comparison  study  [1],  Its  mass  properties  are  given  in  Table  6.  The 
moments  of  inertia  were  about  the  CM. 


B.1.5  F-16  aircraft 

The  single-engine  fighter  chosen  for  both  subsonic  and  supersonic  atmospheric  flight  scenarios  was  based  on 
a fairly  well-known  example,  the  General  Dynamics  (now  Lockheed  Martin)  F-16.  Stevens  and  Lewis  [2] 
provided  a FORTRAN  model  of  this  aircraft  for  subsonic  flight  in  their  text.  Garza  and  Morclli  [3]  expanded 
this  model  with  additional  wind-tunnel  data  from  another  NASA  report  [4], 

This  expanded  model  was  converted  from  Matlab®  scripts  of  Garza  and  Morelli  into  the  ANSI/AIAA 
S-l  19-2011  format  [5].  The  expanded  model  set  included  aerodynamic,  mass  properties,  and  propulsion 
subsystem  models  that  were  implemented  as  function  tables  for  most  of  the  aero  and  propulsion  force  and 
moment  contributions;  the  mass  properties  were  fixed  constants  given  in  Table  7. 

Two  additional  subsystem  models  were  developed  to  provide  a simple  linear  quadratic  regulator  (LQR) 
stability  augmentation  control  law,  allowing  simple  maneuvering  with  pre-programmed  pilot  inputs  as  in 
atmospheric  cases  11  and  13,  and  an  autopilot  controller  designed  to  perform  the  circumnavigations  described 
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Table  6.  Mass  Properties  for  Cylinder 


Parameter  Value 


Ixx 

500 

kg- 

■nr 

lyy 

12,250 

kg- 

■m' 

Izz 

12,250 

kg- 

■m' 

Ixy 

0.0 

kg- 

■nr 

lyz 

0.0 

kg- 

■nr' 

Izx 

0.0 

kg- 

■nr' 

m 

1,000 

kg 

X 

6.0 

m 

y 

0.0 

m 

z 

0.0 

m 

Table  7.  Example  F-16  Mass  and  Inertial  Characteristics 


Parameter  Value 


S 

300.0 

ft  2 

b 

30.0 

ft 

c 

11.32 

ft 

1 XX 

9,496.0 

slug-ft2 

lyy 

55,814.0 

slug-ft2 

Izz 

63,100.0 

slug-ft2 

Ixy 

0.0 

slug-ft2 

lyz 

0.0 

slug-ft2 

Izx 

982.0 

slug-ft2 

m 

637.26 

slug 

X 

25% 

MAC 

y 

0.0 

ft 

Z 

0.0 

ft 
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in  atmospheric  cases  15  and  16.  These  models,  described  below,  are  available  in  S-119  format  from  the  Web 
repository  found  at  http://nescacademy.nasa.gov/flightsim/index.html. 


F-16  Autopilot  with  stability  augmentation  system  — F16_control . dml  The  S-119-encoded  model 
named  F16_control . dml  provided  stability  augmentation  for  subsonic  piloted  flight  as  well  as  a selectable 
three-axis  autopilot  with  course  capture-and-track  capability.  It  was  the  basis  for  the  more  specialized 
maneuvering  F16_gnc.dml  autopilot  described  next,  but  was  used  as-is  for  the  arbitrary  maneuvering  in 
check-case  13. 

Inputs  to  the  controller  are  given  in  Table  8;  outputs  are  shown  in  Table  9. 

Two  discrete  inputs  controlled  the  behavior  of  the  control  system.  If  the  stabilityAugmentationOn_disc  input 
was  ‘true’  (>  0.5),  the  vehicle’s  dynamics  were  stabilized  through  feedback.  This  was  the  mode  used  in  this 
assessment. 

If  autopilotOmdisc  was  ‘true,’  stability  augmentation  was  engaged  and  the  vehicle  responded  to  airspeed, 
altitude,  and  heading  commands  (equivalentAirspeedCommand,  altitudeMsICommand  and  trueBaseCourse- 
Command,  which  acted  as  a desired  heading  input).  If  lateralDeviationError  was  non-zero,  the  vehicle  at- 
tempted to  intercept  and  track  a desired  course  along  the  direction  supplied  in  trueBaseCourseCommand. 

Two  simple  LQR  gain  feedback  matrices  were  used  to  provide  stabilization  of  the  longitudinal  and  lat- 
eral/directional axes.  The  choice  of  weighting  to  select  the  gains  was  somewhat  arbitrary  and  non-optimal, 
and  resulted  in  a fairly  high-bandwidth  closed-loop  system.  This  controller  is  completely  unsuitable  for 
manned  flight  and  probably  piloted  motion-based  simulation,  but  served  to  exercise  the  F-16  model  for 
atmospheric  subsonic  check-case  11. 

Supplied  LQR  gain  values  were  intended  for  flight  at  10,000  ft  and  287  kt  equivalent  airspeed  (KEAS).  Flight 
at  other  speed/altitude  combinations  was  sub-optimal  or  even  unstable. 

No  pilot  inputs  were  used  in  any  of  the  check-cases. 

No  actuator  dynamics  were  modeled  in  an  attempt  to  keep  the  implementation  as  simple  as  possible. 

While  trimming  the  F-16  model  to  an  equilibrium  state,  stabilityAugmentationOmdisc  and  autopilotOmdisc 
were  both  set  to  ‘false’  (<  0.5).  It  was  recommended  that  the  simulation  tool’s  trim  feature  should  ad- 
just the  inputs  trimmedPilotControLthrottle  and  trimmedPilotControl Jong  to  trim  the  longitudinal  state  of 
the  vehicle.  If  the  simulation’s  trim  feature  instead  manipulated  pilotControLthrottle  and  pilotControl  Jong, 
then  the  simulation  should  have  set  trimmedPilotControLthrottle  and  trimmedPilotControl  Jong  to  zero.  (The 
F16_control . dml  file  specifies  a non-zero  initial  condition  for  these  two  trim  variables  that  is  close  to  their 
trim  values  for  straight  and  level  flight  at  10,000  ft  mean  sea  level  (MSL)  and  Mach  0.5.) 

The  original  model  was  encoded  in  the  S-119  format.  It  has  been  converted  into  hierarchical  system  block 
diagrams  for  this  report  to  better  describe  its  operation;  but  the  S-119  model  F16_control . dml  was  the 
normative  description  of  this  model. 

The  top-level  F16-Control  block  is  shown  in  Figure  2.  The  inputs  and  outputs  are  described  in  Tables  8 and 
9 respectively. 


Lateral  autopilot  block.  This  part  of  the  F16.contiol  system,  shown  in  Figure  3,  attempted  to  steer  the 
vehicle  through  bank  commands  to  acquire  and  track  a given  course.  If  lateral  track  error  was  available, 
the  controller  would  attempt  to  reduce  that  error.  Some  logic  was  required  to  wrap  the  resulting  ground 
track  angle  feedback  signal  to  fall  within  ±180  deg.  This  error  was  multiplied  by  a gain,  was  limited  to  ±30 
degrees,  and  was  output  as  the  commanded  bank  angle  (autopilotCommandedBankAngle)  (±RWD). 
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Figure  2.  F16.control\  Simple  LQR-based  Stability  Augmentation  and  Autopilot  for  Example  Simulations 
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Table  9.  Output  Signals  - F16_control . dml 


Name 

Units 

Sign 

Description 

elevatorDeflection 

deg 

+TED 

Elevator  command 

aileronDeflection 

deg 

+LWD 

Aileron  deflection  (right  - left) / 2 

rudderDeflection 

deg 

+TEL 

Rudder  deflection 

powerLeverAngle 

pet 

0 100 

Throttle  (power  lever  angle)  50 
is  MIL  (max  dry)  thrust;  100  is 
MAX  (burner) 

Altitude  autopilot  block.  This  part  of  the  F16-Control  system,  shown  in  Figure  4,  formed  an  error 
between  the  commanded  altitude  (altitudeMsICommand)  and  current  altitude  above  sea  level  (altitudeMsI), 
multiplied  by  a gain  of  —0.05  deg/ft,  limited  the  product  to  ±5  and  added  this  change  in  pitch  to  the 
designEulerAngle_pitch  angle  to  form  the  autopilotPitchCmd  output  (+ANU). 


FI 6 control:  Altitude  A/P 


Figure  4.  Altitude  autopilot : Calculate  Pitch  Angle  Delta  Command  to  Hold  an  Assigned  Altitude 


LQR  input  selection  block.  This  portion  of  the  F16.control  system,  shown  in  Figure  5,  selected  the 
reference  quantities  for  pitch  attitude,  bank  attitude,  and  reference  airspeed  used  to  form  the  error  for  the 
LQR  controller  for  these  quantities.  If  autopilotOmdisc  > 0.5,  the  previously  calculated  autopilotPitchCmd 
and  autopilotCommandedBankAngle  values,  along  with  a user-provided  equivalentAirspeedCommand,  were 
fed  to  the  downstream  LQR  controller;  otherwise  the  trimmed  designEulerAnglePitch  and  designEquivalent- 
Airspeed  were  used  along  with  a value  of  0.0  for  bank  angle  reference. 


Form  LQR  error  block.  As  shown  in  Figure  6,  this  portion  of  the  F16-Control  system  compared  (sub- 
tracted) the  selected  reference  quantities  for  pitch  attitude,  bank  attitude,  and  velocity  from  the  current 
sensed  values.  It  also  formed  an  error  between  the  trimmed  angle  of  attack  and  current  angle  of  attack. 
Quantities  that  are  normally  zero,  including  angle  of  sideslip,  and  body  rates,  were  also  fed  back  as  errors. 

These  errors  were  then  passed  to  the  actual  LQR  gain  blocks. 
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F16_control:  LQR  input  selection 


autopilotOn_disc  ( 6 ) 

CD 


autopilotPitchCmd 


(D 

designEulerAnglePitch 

CD 

autopilotCommandedBankAngle 


CL> 


equivalentAirspeedCommand 


CD 


designEquivalentAirspeed 


-*D 


switchedThetaCmd 


—►CD 

switchedPhiCmd 


— ►CD 

switchedKEAScmd 


Figure  5.  LQR  input  selection:  Select  Between  Trimmed  and  Commanded  Pitch,  Roll,  and  Airspeed  LQR 
Reference  Inputs 

LQR  block.  This  portion  of  the  F16-Control  system,  shown  in  Figure  7,  multiplied  errors  in  the  eight 
state  variables  (four  longitudinal,  four  lateral/directional)  to  calcluate  corrections  to  the  longitudinal,  lateral, 
directional  control  surface  and  throttle  commands. 

The  gains  were  picked  for  the  10,000  ft,  Mach  0.5  flight  condition;  operation  at  other  flight  conditions  may 
not  be  satisfactory. 


Engage  logic  block.  This  part  of  the  F16-Control  system,  shown  in  Figure  8,  limited  pilot  inputs  and, 
depending  on  the  autopilot  and  stability  augmentation  engage  settings,  either  passed  those  pilot  inputs 
directly  to  the  surfaces  and  engine  power  lever,  augmented  them  with  LQR-derived  stability  augmentation 
signals,  or  disregarded  them  entirely  when  the  autopilot  was  engaged. 

When  the  autopilot  was  engaged  (autopilotOmdisc  > 0.5)  the  stability  augmentation  signals  were  automati- 
cally included  in  the  output  signals. 


Limit  and  scale  block.  This  last  piece  of  the  F16-Control  system,  shown  in  Figure  9,  initially  limited 
output  commands  to  ±1.0  (full-scale)  and  then  scaled  these  outputs  to  the  maximum  deflection  angle  for 
the  control  surfaces  and  the  power  lever.  An  aileron-to-rudder  interconnect  (ARI)  gain  provided  rudder 
commands  to  minimize  sideslip  while  maneuvering  the  vehicle. 


F-16  Guidance,  autopilot  and  stability  augmentation  system  — F16_gnc.dml  A more  capable 
control  system  was  provided  in  the  F16-gnc  model,  encoded  in  S-119  model  as  F16_gnc.mdl.  This  used 
the  same  autopilot  and  LQR  control  system  as  the  F16.control  control  system  model  discussed  previously, 
but  added  a guidance  block  upstream  of  the  autopilot.  This  guidance  block  provided  bank  angle  steering 
commands  to  the  autopilot  to  guide  the  vehicle  in  a circular  flight  path  around  a designated  latitude/longitude 
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FI 6 control:  Form  LQR  error 


cd— 

angleOf  Attack 


O 


designAngleOfAttack 


g>— 

angleOfSideslip 

c±>- 

eulerAngle_Roll 


CD- 


switchedPhiCmd 


CI> 


eulerAngle_Pitch 


c°> 


switchedThetaCmd 


CE> 


bodyAngularRate_Roll 


cz> 


bodyAngularRate_Pitch 


cd> 


bodyAngularRate_Yaw 


CD- 


equivalentAirspeed 


CD 


switchedKEASCmd 


MCD 

disturbedAngleOfAttack 

KD 

disturbedAngleOfSideslip 

►CD 

disturbedEulerAngle_Roll 

KD 

disturbedEulerAngle_Pitch 

KD 

disturbedAngularRate_Roll 

►CD 

disturbedAngularRate_Pitch 

►CD 

disturbedAngularRate_Yaw 

►CD 

disturbed  EquivalentAirspeed 


Figure  6.  Form  LQR  Error.  Select  Between  Trimmed  and  Commanded  Pitch,  Roll  and  Airspeed  LQR 
Reference  Inputs 
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F16_control:  LQR 


Figure  7.  LQR:  Linear  Quadratic  Regulator  for  Subsonic  F-16  Model 
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F16_control:  Engage  logic 


Figure  8.  Engage  logic:  Select  Sources  to  Drive  Control  Surfaces  and  Power  Lever  Angle 


NESC  Document  No.:  NESC-RP-12-00770,  Volume  II 


© 

NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

25  of  609 

FI 6 control:  Limit  and  scale 


CD 

totalLongCmd_unlim 


j\ 

totalLongCmcT 

-1.0  to  1.0 


—►CD 

elevatorDeflection 


0.0  to  1.0 


Figure  9.  Limit  and  scale : Limit  and  Scale  Output  Commands 


NESC  Document  No.:  NESC-RP- 12-00770,  Volume  II 


© 

NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

26  of  609 

position.  In  particular,  this  system  included  a selection  input  that  would  circumnavigate  either  the  North 
Pole  or  the  Equator/International  Date  Line  (IDL)  intersection  in  a counter-clockwise  direction.  This  control 
algorithm  was  used  for  atmospheric  check-cases  15  and  16  instead  of  the  F16montrol  used  for  check-case  13. 

Inputs  to  the  F16-Control  system  are  given  in  Table  10;  outputs  are  shown  in  Table  11. 

The  primary  difference  between  F16_gnc  and  F16-Control  was  the  GNC  version  had  no  trueBaseCourse- 
Command  or  lateralDeviationError  input;  the  behavior  of  the  vehicle  when  autopilotOn_disc  was  ‘true’  (>  0.5) 
depended  on  the  value  of  selectCircumnavigator_disc:  if  ‘false’  (<  0.5),  the  vehicle  would  be  commanded  to  fly 
toward  and  circle  around  the  Equator/IDL  intersection;  if  ‘true’  (>  0.5),  the  vehicle  would  be  commanded 
to  fly  toward  and  circle  the  North  Pole  at  a distance  of  3 nautical  miles  at  the  specified  altitude  and  speed. 
In  addition  to  the  new  selectCircumnavigator_disc  input  were  two  new  navigation  feedback  signal  inputs, 
geLatitude  and  geLongitude,  for  the  current  vehicle  geodetic  latitude  and  longitude  position  coordinates, 
respectively. 

The  outputs  were  the  same  as  for  F16-Control. 

These  circles  took  approximately  3.5  simulated  minutes  at  10,000  ft  and  287  KEAS. 

The  F16_gnc  model  was  encoded  and  made  available  to  participants  in  the  S-119  format.  It  was  converted 
into  the  hierarchical  system  block  diagrams  shown  in  this  report  to  better  describe  its  operation;  but  the 
S-119  model  file  F16_gnc.dml  is  the  normative  description  of  this  model. 

The  top-level  F16.gnc  block  is  shown  in  Figure  10.  The  inputs  and  outputs  are  described  in  Tables  10  and 
11  respectively. 

With  the  exception  of  the  Circumnavigator  block,  the  F16-gnc  system  had  the  same  structure  as  the  previ- 
ously described  F16-Control  system. 


Circumnavigator.  The  block  that  was  unique  to  the  F16.gnc  system  was  the  Circumnavigator  block, 
depicted  in  Figure  11.  This  block  took  current  “ownship”  position  and  generated  both  a heading  angle 
(trueBaseCourseCommand)  and  a lateral  offset  value  (lateralDeviationError),  which  the  downstream  autopi- 
lot structure  (identical  to  the  F16montrol  autopilot  previously  described)  used  to  steer  the  vehicle  in  the 
horizontal  plane  through  a varying  bank  angle  command. 

The  value  of  the  selectCircumnavigator_disc  input  chose  whether  the  circumnavigator  would  steer  toward  a 
circle  around  the  North  Pole  or  a circle  around  the  Equator/IDL  intersection.  In  the  case  of  the  North 
Pole  (selectCircumnavigator_disc  > 0.5),  the  baseline  heading  angle  was  a constant  90°  for  a counterclockwise 
encirclement.  The  lateral  offset  was  calculated  by  subtracting  the  current  ownship  geodetic  latitude  in 
degrees  from  90°,  converting  that  angular  distance  from  the  North  Pole  into  feet,  and  then  subtracting  the 
desired  circular  radius  (3  nm,  converted  to  feet)  to  arrive  at  the  distance  outside  (+  or  right  of  desired 
course)  or  inside  (—  or  left  of  desired  course)  the  circle  as  the  lateral  offset  value. 

In  the  case  of  selecting  the  Equator/IDL  intersection  (selectCircumnavigator_disc  ==  0),  the  distance  of  the 
ownship  from  the  intersection  was  the  sum  of  the  squares  of  latitude  converted  to  feet,  and  (180—  |longitude|) 
converted  into  feet.  From  this  distance  the  radius  of  the  3 nm  circle,  converted  to  feet,  was  subtracted  to 
form  the  distance  outside  (+  right)  or  inside  (—  left)  of  the  desired  circle.  The  heading  command  was  the 
tangent  angle  of  the  circle  heading  counter-clockwise,  which  was  simply  the  four-quadrant  arc  tangent  of  the 
ratio  of  north  displacement  to  east  displacement,  converted  to  degrees. 
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Figure  10.  F16-gnc:  Guidance  and  Control  System  for  Check-cases  15  and  16 
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Table  11.  Output  Signals  - F16_gnc.dml 


Name 

Units 

Sign 

Description 

elevatorDeflection 

deg 

+TED 

Elevator  command 

aileronDeflection 

deg 

+LWD 

Aileron  deflection  (right  - left) / 2 

rudderDeflection 

deg 

+TEL 

Rudder  deflection 

powerLeverAngle 

pet 

0 100 

Throttle  (power  lever  angle)  50 
is  MIL  (max  dry)  thrust;  100  is 
MAX  (burner) 

B.1.6  Two-stage  rocket 

A two-stage  rocket  model  was  imagined  by  Dr.  Eric  Queen  of  NASA’s  Langley  Research  Center  (LaRC)  for 
this  effort  in  an  unpublished  document.  The  scenario  involved  a two-stage  rocket  being  fired  from  the  Equator 
at  an  initial  pitch  attitude;  during  the  boost,  a short  coast  occurred  after  the  first  stage  was  expended,  and 
then  the  second  stage  fired  (which  included  a step  change  in  the  location  and  amount  of  mass)  as  the  vehicle’s 
flight  path  pitched  over  in  response  to  gravity.  At  the  end  of  the  second-stage  firing,  the  remaining  vehicle 
mass  was  intended  to  be  in  a highly  elliptical  orbit. 

A notation  on  one  page  of  the  original  document  indicates  the  aero  data  are  based  on  “V2  at  Mach  3” ; another 
notation  indicates  the  rockets  are  modeled  after  the  Shuttle  solid  rocket  boosters  (SRB).  No  attribution  of 
any  other  data  appeared  necessary. 

The  vehicle  was  envisioned  to  be  two  3 m diameter  solid  rocket  boosters  stacked  vertically;  the  first  stage 
was  25  m long  with  a dry  mass  of  35,000  kg  and  180,000  kg  of  propellant.  The  second  stage  was  10  m long 
with  a dry  mass  of  15,000  kg  carrying  80,000  kg  of  propellant,  for  a total  booster  length  of  35  m.  It  was 
carrying  a 4,000  kg  payload  to  orbit. 

The  vehicle  was  stable  and  had  no  active  guidance  or  control. 

The  vehicle  model  was  provided  in  the  following  files: 

• twostage_aero . dml,  Rev  A,  dated  2014-03-27:  simple  aerodynamics  model 

• twostage_prop . dml,  dated  2013-08-10:  simple  propulsion  model 

• twostage_inertia. dml,  dated  2012-08-09:  mass  properties  model 

The  inputs  and  outputs  for  each  of  these  models  are  given  in  Tables  12  to  18  below. 


Two-stage  rocket  aerodynamics  model  — twostage_aero . dml.  The  aero  model  for  the  two-stage 
rocket  had  two  inputs  - angle  of  attack,  a and  angle  of  sideslip,  /3  - that  were  defined  in  an  aircraft  sense: 


tana  = 


wb 

Ub 


sin  /3 


Vb 

V 


These  angles  were  used  to  form  a “total  angle  of  attack”  (atotai)  giving  the  angle  of  the  velocity- vector  to 
the  rocket  body  centerline  as 
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atotal  = 'Joi2  + /32 

These  three  angles  (a,  atotal;  /3)  were  used  as  inputs  into  linearly  interpolated  one-dimensional  (ID)  function 
tables. 

Outputs  were  the  traditional  aerodynamic  force  and  moment  coefficients  measured  about  the  reference  point 
(the  location  of  the  reference  point  along  the  central  body  axis  was  an  output  of  the  inertia  model,  and 
changed  depending  on  whether  the  vehicle  had  staged  or  not).  Rolling  moment  was  identically  zero  for 
convenience. 


Table  12.  Input  Signals  - twostage_aero . dml 


Name 

Units 

Sign 

Description 

angleOfAttack 

deg 

+ANU 

Angle  of  attack 

angleOfSideslip 

deg 

+ANL 

Angle  of  sideslip 

Two-stage  rocket  propulsion  model  — twostage_prop . dml.  The  first  stage  was  modeled  as  having 
17,000,000  N thrust  with  an  Isp  of  360  sec.  The  second  stage  had  5,000,000  N thrust  with  an  /sp  of  390  sec. 
Both  stages  were  to  burn  in  turn  until  all  the  propellant  in  each  stage  was  depleted. 

It  was  an  error  to  have  both  stages  burning  simultaneously. 


Two-stage  rocket  mass  properties  model  — twostage_inertia. dml.  This  model  linearly  interpolates 
mass  properties,  including  center  of  mass  location,  during  flight.  Inputs  were  total  fuel  consumed  in  stages  1 
and  2 and  a flag  to  indicate  if  the  vehicle  had  staged  (dropped  the  first  stage).  Outputs  were  mass  properties, 
fuel  fraction  consumed  in  both  stages,  and  the  location  of  the  moment  reference  center  (which  moved  when 
the  vehicle  staged). 

The  starting  mass  properties  of  each  stage  are  given  in  Table  16. 


Implementation.  Inputs  from  the  simulation  framework  were  normal  flight  conditions:  angle  of  attack, 
angle  of  sideslip,  and  dynamic  pressure.  These  were  used  to  obtain  aerodynamic  coefficients  of  forces  and 
moments  about  the  current  moment  reference  center  (MRC),  which  changed  when  the  vehicle  staged. 

The  specified  ICs  (see  below)  were  assumed  for  the  flight  conditions,  and  the  first  stage  was  ignited  by  passing 
the  appropriate  flag  to  the  propulsion  model.  The  resulting  thrust  acted  along  the  body  cc-axis  and  began 
to  accelerate  the  vehicle.  The  amount  of  fuel  consumed  by  each  stage  had  to  be  calculated  by  external  logic; 
the  mass  of  fuel  consumed  was  provided  to  the  inertia  model,  which  provided  the  current  mass  properties 
including  the  offset  between  the  CM  and  the  aerodynamic  MRC. 

This  moment  arm  was  used  to  transfer  the  aero  forces  and  moments  from  the  reference  center  to  the  current 
CM  using  an  external  cross-product  operation  of  the  two  vector  quantities;  thus  the  actual  moments  and 
aerodynamic  forces  were  summed  with  the  thrust  value  from  the  propulsion  model  and  accelerations  were 
calculated  at  the  CM. 

The  simulation  framework  integrated  the  accelerations  twice  to  arrive  at  new  flight  conditions,  and  the 
simulation  loop  would  then  start  over. 


NESC  Document  No.:  NESC-RP-12-00770,  Volume  II 


© 

NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document  #: 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

32  of  609 

a 

T3 

O 

U 

<D 

cd 

0 

bf) 

cd 

■P 

w 

o 

£ 

■p 


p 

bJO 


P 

CP 

-4-i 

O 


ie 

H 


a 


0 

p 

r^d 

"E 


X5 

O 

P^ 


P -H 
0 £ 
P 0 


P .w 
x 

Pd  cd 

+3  I 

cd  P5 
a 

-H  X5 
Pd  o 
.bO  ^ 

Pd 


« bO  ~ 

bJO  .g 

S rd  .3 

o § 

Q-l  J>5 
w CO  CO 

■5  a ’3  a 

■g  ro  cd  cd 
CP  ^ ii  N 


-e  >> 

r-P  rTi 

M ^ 

cfi  -Q 


K*1  K'j 

TJ  T5 


co 

P 22, 

0 

^ P^ 

fl)  -P3 

£ fe 

qj  ^ q 

E 0 ^ 

<v>  0 

p P cd 

. CD  O 
—s  Sh  f-i 

a ^ 03 

o £ g 

3^  fl 

P S Oi 

s3  S s 

n ^ =+h 
O ii  » 
PI  hP  P3 


a 


0 

p=! 

-p 

XS 

P 

P 

O 


cd  cd  cd  cd  cd 


cd 

CP 


n3  -+->  +i  -+J 

Q,  C3  P P 

M D QJ  QJ 


rP  rP  fP 


a a 

O O 

a 


o o o o o o 

+3  -+J  -P  -+J  -+J  -+J 

P 3 £ P P P 

0 0 0 0 0 0 

‘o  'o  'o  'o  'o  ’o 

n~!  <r~!  f i — ! f |— ! cr~!  rr~! 

tfi  tc  ® tfi  cfi  CR 

0 0 0 0 0 0 

o o o o o o 

0 0 0 0 0 0 

0 Cd  0 0 0 0 

4J  4J  -p  -p  -P  -P 

£ £ eS  eS  eS  £ 


+3  fl  Q t)  cd 

in  §*i>i^ii 

8 8 8 + ^ p^t  + 


a a"g 


i i 


bO 

bO 

0 

0 

0 

0 

0 

0 

d 

d 

< 

'0 

'0 

-0 

'0 

'0 

'<J 

0 

0 

0 

_l 

_1 

0 

M — 

M — 

M— 

M — 

M — 

M— 

0 

0 

c 

0 

0 

0 

0 

0 

0 

0 

0 

0 

o 

o 

o 

o 

o 

o 

d 

d 

^_ 

U 

u 

u 

u 

u 

u 

0 

0 

.+-> 

0 

bO 

+-» 

+-» 

+-> 

£ 

£ 

0 

M— 

0 

03 

d 

0 

d 

0 

d 

0 

0 

QC 

0 

QC 

E 

0 

~o 

E 

o 

E 

o 

E 

o 

03 

ru 

i_ 

~o 

"v> 

. E 

0 

bO 

bO 

bO 

~o 

+-> 
a 3 

d 

d 

d 

d 

4-» 

i= 

1c 

£ 

'bO 

d 

o 

O 

0 

+-> 

'o_ 

03 

> 

NESC  Document  No.:  NESC-RP-12-00770,  Volume  II 


n 

NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

33  of  609 

Table  14.  Input  Signals  - twostage_prop . dml 


Name 

Units 

Sign 

Description 

stagelfiring_flag 

0,  1 

+firing 

Indicates  if  the  first  stage  is  firing 

stage2firing_flag 

0,  1 

+firing 

Indicates  if  the  second  stage  is  firing 

External  logic  was  also  required  to  account  for  the  angular  momentum  carried  away  by  the  rocket  exhaust. 
This  term  is  the  product  of  a fractional  gain,  the  rate  of  change  of  the  mass  tensor,  and  the  rocket  angular 
rate.  For  the  check-cases,  it  was  assumed  that  the  exhaust  would  carry  away  half  the  angular  moment  change 
(i.e.  fraction  gain  = 0.5)  due  to  the  mass  tensor  change. 

Some  internal  logic  was  required  to  turn  off  the  first  stage  when  it  was  depicted  (remaining  fuel  fraction 
reached  0),  then  the  vehicle  was  allowed  to  coast  for  96.79  sec  before  the  first  vehicle  was  dropped  (or  staged) 
and  the  second  stage  was  ignited.  The  second  stage  continued  to  burn  until  fuel  depletion. 

At  this  point  the  vehicle  was  in  an  elliptical  orbit  with  a perigee  greater  than  125  km  for  a circular,  rotating, 
Earth. 

The  simulation  framework  was  responsible  for  the  appropriate  atmospheric  model,  integrating  both  the 
equations  of  motion  (EOM)  and  the  fuel  consumed  values,  providing  the  moment  transfer  to  the  center  of 
mass,  estimating  the  angular  momentum  lost  to  the  engine  exhaust,  and  providing  the  simple  switching  and 
timing  logic  for  coasting  and  staging  upon  depletion  of  the  propellant  of  the  first  stage. 


Initial  conditions  The  rocket  was  launched  from  sea  level  at  the  Equator  heading  eastward  with  an  initial 
pitch  attitude  of  55.220  degrees  (measured  from  horizontal).  The  initial  velocity  was  +0.1  ft/s  upwards  for 
comparisons  sake  and  to  avoid  singularities  involving  division  by  zero. 

For  simplicity’s  sake,  the  center-of-mass  of  the  vehicle  started  at  sea  level  (which  would  have  physically 
placed  the  lower  part  of  the  rocket  below  sea  level). 

Initial  angular  rates  were  zero  with  respect  to  the  launch  site.  The  vehicle  pitched  over  along  the  flight  path 
in  response  to  the  effect  of  gravity  as  it  accelerated  away  from  the  launch  site  (a  so-called  ‘gravity  turn’). 


Atmosphere  model  For  comparison,  the  full  U.S.  Standard  Atmosphere  1976  was  specified  for  this  check- 
case  [6].  Many  simulations  that  support  the  1976  atmosphere  do  not  include  the  portion  in  the  thermosphere, 
which  is  a separate  set  of  tables  or  equations.  Therefore  for  comparison  purposes,  the  atmospheric  density 
was  set  to  zero  above  86  km.  This  zeroed  the  atmospheric  forces  and  moments  in  the  thermosphere. 
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Table  16.  First-stage  Mass  and  Inertial  Characteristics 


Parameter  Units 

Stage  1 

Full 

Empty 

Stage  1 

Full 

Empty 

I XX 

kg-m2 

353,250 

150,750 

111,375 

21,375 

lyy 

kg-m2 

33,501,637.473  461  10,886,636.572  139 

941,063.762  626  212 

,384.868  421 

Izz 

kg-m2 

353,250 

150,750 

111,375 

21,375 

Ixy 

kg-m2 

0.0 

0.0 

0.0 

0.0 

lyz 

kg-m2 

0.0 

0.0 

0.0 

0.0 

Izx 

kg-m2 

0.0 

0.0 

0.0 

0.0 

m 

kg 

314,000 

134,000 

99,000 

19,000 

X 

m 

16.918  790 

9.421  642 

4.797  980 

3.947  368 

y 

m 

0.0 

0.0 

0.0 

0.0 

Z 

m 

0.0 

0.0 

0.0 

0.0 

Table  17.  Input  Signals  - twostage_inertia. dml 


Name 

Units 

Sign 

Description 

rocketHasStaged 

0,  1 

-l-staged 

If  non-zero,  indicates  first  stage  is  missing. 

stagelfuelConsumed 

kg 

- 

Amount  of  fuel  burned  in  first  stage 

stage2fuelConsumed 

kg 

- 

Amount  of  fuel  burned  in  second  stage 
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B.1.7  ISS 

A vehicle  with  a mass  distribution  representative  of  the  International  Space  Station  (ISS),  used  in  certain 
orbital  check-cases,  was  reused  from  the  earlier  orbital  simulation  comparison  study  [1].  Its  mass  properties 
are  given  in  Table  19.  The  moments  and  products  of  inertia  were  given  about  axes  that  originate  at  the  CM. 

Table  19.  Mass  Properties  for  ISS-like  Vehicle 


Parameter 

Value 

*xx 

1.02  x10s  kg-m2 

lyy 

0.91x10®  kg-m2 

^zz 

1.64x10®  kg-m2 

Ixy 

6.96xl06  kg-m2 

lyz 

— 5.90xl05  kg-m2 

^zx 

5.48xl06  kg-m2 

m 

400,000  kg 

X 

—3.0  m 

y 

— 1.5  m 

Z 

4.0  m 

B.2  Geodesy  models 

This  section  describes  the  way  in  which  most  flight  simulation  tools  model  the  surface  of  the  Earth.  We 
describe  three  simple  models  that  are  commonly  used  in  the  simulation  of  atmospheric  and  orbital  vehicles. 

There  is  a connection  between  models  for  gravitation  and  those  for  geodesy.  Geodetic  models  include  a 
reference  surface  to  serve  as  an  idealized  sea  level.  By  definition  any  such  surface  should  also  be  a level 
surface  for  the  gravity  potential  function  (which  is  the  sum  of  gravitation  and  the  centrifugal  acceleration 
due  to  the  Earth’s  rotation),  i.e.  it  should  be  normal  to  the  local  gravity  vector. 

The  pairing  of  geodetic  and  gravitational  models  considered  here  is 

• Flat  Earth  - constant  gravitation  assumed 

• Spheroidal  Earth  - inverse  square  law  gravitation  model1 

• Ellipsoidal  Earth  (World  Geodetic  System  1984  (WGS-84))  - spherical  harmonic  gravitation  model 

For  the  round  and  ellipsoidal  models,  we  locate  points  using  the  familiar  altitude  h,  latitude  (f>  and  longitude  A. 
The  altitude  should  be  measured  along  the  normal  vector  v to  the  surface  of  the  reference  shape  (sphere  or 
ellipsoid).  The  latitude  <fi  is  defined  to  be  the  angle  between  V and  the  equatorial  plane  z = 0.  If  v is  the 
projection  of  V on  the  equatorial  plane,  then  the  longitude  A is  the  angle  between  (0,  p]  and  v where  P is 
the  intersection  of  the  Prime  Meridian  and  the  Equator.  We  adopt  the  sign  convention  that  east  longitude 
is  positive  as  is  latitude  north  of  Equator. 

1 The  round  Earth  is  commonly  paired  with  the  inverse  square  law  gravitation  model.  However,  the  resulting  gravity  vector 

(gravitation  plus  centrifugal  acceleration  due  to  the  Earth’s  rotation)  is  deflected  from  the  surface  normal  because  the  inverse 

square  law  generates  no  northward  component  of  gravitation  to  counteract  the  southward  component  of  centrifugal  acceleration 

due  to  the  Earth’s  rotation  that  appears  at  locations  away  from  the  pole  and  Equator.  This  problem  disappears  if  the  round 

Earth  is  modeled  without  rotation,  but  the  resultant  gravity  is  then  overestimated  by  a slight  amount  at  many  locations  due 
to  the  missing  centrifugal  acceleration. 
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B.2.1  Flat  Earth 

The  simplest  way  to  model  the  surface  of  the  Earth  is  as  a plane.  The  coordinates  for  such  a system 
are  usually  given  in  either  runway-aligned  coordinates  (for  terminal  maneuvers)  or  in  a three-dimensional 
framework  oriented  north,  east  and  down.  In  at  least  one  approximation  the  position  of  the  vehicle  is  given 
as  geodetic  latitude,  longitude  and  radius  from  the  center  of  Earth,  which  are  spherical  coordinates,  but  the 
“translational  rates”  of  these  spherical  positions  are  integrated  as  if  they  were  translational  rates  across  a 
flat  surface. 

These  are  valid  approximations  for  the  appropriate  simulation  application  but  generally  lead  to  errors  in 
line-of-sight  calculations  and/or  high-speed  flight. 

B.2.2  Spheroidal  Earth 

The  next  step  on  the  ladder  of  complexity  is  to  model  the  Earth  as  a perfect  sphere.  To  this  end,  we  need 
only  a single  number  r2,  the  radius  of  a sphere  with  an  equal  surface  area  as  the  WGS-84  ellipsoidal  Earth, 
to  specify  the  model.  The  equation  of  the  point  s on  the  surface  of  a spherical  Earth  is  simply 

X2  + Y2  + Z2  = r\  (9) 

While  coordinate  systems  are  discussed  in  the  next  section,  it  is  appropriate  to  state  the  method  for  moving 
between  spherical  coordinates  (latitude,  longitude  and  altitude)  to  frequently-used  rectangular  coordinates, 
as  shown  in  Figure  12. 


Figure  12.  Relationship  between  Earth-fixed  Cartesian  Coordinates  and  Spherical  (geocentric)  Coordinates 
for  Spherical  Earth 
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The  conversion  from  spherical  altitude,  latitude,  and  longitude  coordinates  to  the  normally  rotating  Earth- 
centered,  Earth-fixed  (ECEF)  Cartesian  coordinates  is  given  by 

/ X \ / cos(</>)  cos(A)  \ 

| Y I ={h  + r2)  ( cos(</>)  sin(A)  ] (10) 

\ Z ) \ sin (</>)  ) 

The  conversion  in  the  other  direction  from  ECEF  to  altitude,  latitude,  and  longitude  is  described  by 

= vA2  + Y2  + Z2  - r2 

• — i ( ^ \ 

= sin  - ) 

\/X2  +Y2  + Z2 

= atan2(F,X)  (11) 

where  atan2(Y,X)  is  a 4-quadrant  arc-tangent  function. 

B.2.3  WGS-84 

The  World  Geodetic  System  is  a standard  for  use  in  cartography,  geodesy,  and  navigation.  It  comprises  a 
standard  coordinate  frame  for  the  Earth,  a standard  ellipsoidal  reference  surface  (the  datum  or  reference 
ellipsoid)  for  raw  altitude  data,  and  a gravitational  equipotential  surface  (the  geoid)  that  defines  the  nominal 
sea  level.  The  latest  revision  is  WGS-84  (dating  from  1984  and  last  revised  in  2004  [7]). 

Although  WGS-84  is  based  on  just  four  constants,  we  derive  from  them  an  additional  parameter:  rp,  the 
polar  radius.  Due  to  polar  flattening  of  the  Earth,  rv  is  slightly  less  than  re,  as  shown  in  Figure  13. 


h 

</> 

A 


Figure  13.  Relationship  between  Earth-fixed  Cartesian  Coordinates  and  Ellipsoidal  (geodetic)  Coordinates 
for  Spherical  Earth 

The  geodetic  ellipsoid  is  then  defined  by  the  equation 
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X2  + Y2 

r2 
1 e 


+ 


Z2 


= 1 


(12) 


The  transformations  between  altitude,  latitude,  longitude,  and  ECEF  Cartesian  are  significantly  more  com- 
plicated in  the  ellipsoidal  Earth  case.  Note  that  all  meridians  on  the  reference  ellipsoid  are  congruent  ellipses 
having  semi-major  axis  re  and  semi-minor  axis  rp.  The  eccentricity  e of  the  meridian  ellipses  is  a convenient 
parameter  for  expressing  these  transformations. 


e = 


(13) 


Then  we  can  write  the  transformation  from  altitude,  geodetic  latitude,  and  longitude  to  ECEF  as 


X 

Y I = 
Z 


1 — e2  sin2  (j> 


V L 


yh  — e2  sin2  4> 

h + ( 1-e2) 


cos  </>  cos  A 
cos  <j>  sin  A 
sin  (j> 


(14) 


Obtaining  a concise  transformation  in  the  opposite  direction  (from  ECEF  Cartesian  to  h,  <f>,  A)  is  a challenging 
algebra  problem  that  requires  use  of  the  quartic  formula;  often  an  iterative  or  approximation  is  used.  For 
details  on  these  solutions,  see  Borkowski  [8]  or  the  tutorial  video  by  NASA  Engineering  and  Safety  Center’s 
(NESC)  Dr.  James  R.  Beaty  [9]. 


B.3  Coordinate  systems 

An  important  part  of  developing  dynamic  simulations  is  dealing  with  coordinate  systems.  There  are  a 
number  of  such  systems  involved  in  this  study. 

Of  prime  interest  is  the  selection  of  the  system  that  is  considered  to  be  inertial,  or  non-moving.  While  in 
real-life  no  such  system  actually  exists,  low  Earth  orbit  simulation  tools  typically  use  a pseudo- inertial  system 
whose  origin  translates  with  the  planet  center  and  whose  axes  are  fixed  with  respect  to  the  stars,  such  as  the 
J2000  coordinate  system  described  in  section  B.3.1  below.  The  Earth  is  considered  to  be  a rotating  object  in 
the  J2000  system,  and  its  orientation  with  respect  to  the  J2000  system  is  specified  through  a time-dependent 
transformation  matrix  containing  three  rotations. 

Most  aerodynamic  vehicle  simulations  make  a simplification  by  treating  the  Earth  as  an  inertial  system, 
or  as  a rotating  object  that  is  turning  on  its  polar  axis  at  a constant  rate  around  a fixed,  or  inertial, 
coordinate  system  located  at  the  Earth’s  center  (the  Earth-centered  inertial  (ECI)  frame) . Some  aerodynamic 
simulations  simplify  this  even  further  and  treat  a position  on  the  Earth,  such  as  a runway,  as  the  origin  of 
a non-moving  inertial  frame. 

Selection  of  the  inertial  coordinate  system  is  important  to  avoid  introducing  errors  in  the  calculation  of 
derivatives  (linear  velocities  and  accelerations) , or  equivalently,  in  performing  numerical  integration  of  rota- 
tional states,  due  to  rotational  effects. 
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B.3.1  Orbital  flight  coordinates 

Coordinate  systems  are  a fundamental  consideration  in  the  planning,  simulation  and  execution  of  space 
missions.  There  are  often  multiple,  related,  coordinate  systems  for  a single  vehicle,  and  usually  at  least  two 
for  every  celestial  object.  However,  most  of  these  systems  result  from  application-specific  requirements  such 
as  placement  of  sensors  and  other  devices. 

To  keep  matters  as  simple  and  consistent  as  possible,  we  specialize  to  the  case  of  a single  vehicle  body-axis 
system  with  axes  and  origin  fixed  with  respect  to  a rigid  vehicle.  The  mass  properties  of  the  vehicle  will  be 
defined  in  terms  of  this  system.  Since  our  orbital  cases  all  involve  Earth-centric  scenarios,  we  can  eliminate 
all  but  three  planetary  systems  - ECI,  ECEF,  and  the  local  horizontal,  local  vertical  (LVLH)  for  the  vehicle. 

The  ECI  system  is  not  a truly  inertial  system  because  its  origin  is  accelerating  with  the  Earth  as  it  makes  its 
traversal  around  the  sun.  The  key  “inertial”  feature  is  that  the  axes  of  the  ECI  frame  do  not  rotate.  This 
is  critical  because  propagation  of  6-degrees-of- freedom  (DOF)  dynamics  in  a rotating  frame  is  extremely 
complex. 

We  need  the  ECEF  frame  in  order  to  compute  other  environmental  factors  such  as  atmosphere  and  gravity 
that  are  linked  to  the  planet. 

There  is  a key  transformation  that  links  these  two  frames.  This  transformation  is  usually  composed  of  four 
elements: 

• Rotation  - the  rotation  of  Earth  about  its  polar  axis 

• Nutation  - a “wobble”  of  the  polar  axis  with  respect  to  some  mean  value 

• Precession  - the  slow  drift  of  the  mean  pole  around  a 23.5°  cone 

• Polar  motion  - approximated  by  a constant  value  in  these  comparisons 

The  ECI  and  ECEF  systems  used  here  were  established  by  the  International  Earth  Rotation  and  Reference 
System  Service  (IERS).  The  ECI  system,  known  as  J2000,  is  modeled  on  an  equatorial  system  at  the  epoch 
of  noon  on  1 January  2000  in  Greenwich,  England.  It  is  formally  defined  with  respect  to  extra-galactic 
quasar  sources. 

The  IERS  publishes  code  and  data  to  transform  J2000  to  an  Earth- fixed  system  defined  by  its  three  coordinate 
axes  X , Y and  Z. 

• The  X axis  points  from  the  center  of  the  Earth  to  the  intersection  of  Equator  and  Prime  Meridian. 

• The  Z axis  points  from  the  center  of  the  Earth  to  the  north  pole. 

• The  Y axis  is  defined  Y = Z x X 

The  IERS  publishes  code  and  tabular  data,  which  can  be  used  to  compute  X,  Y and  Z in  J2000  coordinates. 
The  rotation-nutation-precession  (RNP)  matrix  M,  which  transforms  from  ECI  to  ECEF,  is  thus  given  by 


where  X , Y and  Z comprise  the  rows  of  the  matrix  M. 
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It  is  useful  to  describe  vehicle  attitude  for  guidance,  navigation,  control  (GNC),  and  communications  by 
means  of  standard  Euler  angles  (roll,  pitch,  yaw)  with  respect  to  an  LVLH  coordinate  system  as  in  Figure  14. 

The  LVLH  system  is  defined  as  follows. 

• Z-axis:  Defined  to  be  a unit  vector  pointing  from  the  vehicle  CM  to  the  CM  of  the  central  body 

• Y-axis:  Defined  as  a unit  vector  that  is  normal  to  the  orbit  plane,  pointing  in  the  direction  opposite 
to  the  instantaneous  orbit  angular  momentum  vector. 

• X-axis:  Completes  a standard,  right-handed  coordinate  frame 


North  Pole 


Figure  14.  LVLH  Frame 


B.3.2  Atmospheric  flight  coordinates 

As  mentioned  previously,  a 6-DOF  atmospheric  flight  simulation  may  treat  the  ECI  coordinate  system, 
located  at  the  center  of  the  Earth,  as  the  inertial  frame  for  state  propagation. 

Many  simulations  assume  the  X-axis  is  in  the  plane  of  the  Prime  Meridian,  but  the  WGS-84  standard  [7] 
actually  uses  the  IERS  Reference  Meridian,  located  about  300  feet  east  of  the  Prime  Meridian. 

Unlike  the  more  complex  RNP  rotations  between  ECEF  and  ECI  systems  in  most  orbital  simulations,  most 
atmospheric  flight  simulations  assume  these  systems  share  the  polar  axis  of  rotation  and  are  related  through 
a single  rotation,  as  shown  in  Figure  15,  where  the  systems  are  coincident  at  some  predefined  time  (typically, 
but  not  necessarily,  t = 0)  and  then  the  ECEF  X-  and  Y-axes  rotate  eastward  around  the  Equator  at  the 
rotational  rate  of  the  Earth.  Sometimes  the  period  of  this  rotation  is  assumed  to  be  24.0  hours,  but  the 
WGS-84  standard  specifies  a mean  Earth  rotational  rate  to  = 7,292,115.0  x 10~n  rad/s  corresponding  to 
the  “inertial”  or  sidereal  period  of  23.9345  hours  (slightly  less  than  a day,  since  the  Earth  is  orbiting  around 
the  sun:  the  Earth  rotates  approximately  361  degrees  in  a solar  day  between  local  noons). 

Propagating  the  position  of  the  vehicle  and  other  items  of  interests  in  the  ECI  frame  is  normally  done  in 
rectilinear  coordinates  X,  Y,  and  Z.  Positions  in  the  ECEF  frame  are  usually  specified  in  polar  coordinates 
of  geocentric  latitude,  geocentric  longitude,  and  radius  from  the  Earth’s  center.  Conversion  between  these 
coordinate  sets  is  straightforward  and  found  in  many  textbooks.  When  performing  navigation  calculations, 
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z,  z 


Figure  15.  Rotation  from  ECI  Frame  to  ECEF  Frame 


however,  coordinates  are  often  necessarily  expressed  in  geodetic  latitude,  longitude  and  altitude  coordinates, 
where  altitude  is  normally  relative  to  “sea  level.”  Converting  from  ECEF  spherical  geocentric  coordinates 
to  geodetic  coordinates  is  a bit  more  involved  due  to  dealing  with  the  WGS-84  reference  ellipsoid.  An 
exact  solution  exists  to  convert  from  geodetic  to  geocentric  (and  is  given  in  Section  B.2.3  above),  but  the 
exact  closed-form  solution  for  the  geocentric  to  geodetic  conversion  problem  involves  solving  a fourth-order 
polynomial.  Simplified  methods  for  dealing  with  this  conversion  vary  between  simulation  tools,  but  involve 
either  an  iterative  solution  or  a one-  or  two-pass  approximation  method.  Refer  to  Section  B.2.3  for  more 
information. 

The  actual  shape  of  the  “sea-level”  zero  altitude  reference  is  a further  complication  involving  considerable 
calculations  to  arrive  at  a useful  approximate,  undulating  geoid  surface.  Many  atmospheric  flight  simulation 
tools  treat  the  WGS-84  reference  ellipsoid  as  the  zero-altitude  reference,  but  this  can  introduce  vertical 
navigation  errors  on  the  order  of  hundreds  of  feet. 

Another  coordinate  system  often  used  is  a local  reference  coordinates  (LRC)  frame  whose  orientation  can 
be  fixed  at  a location  on  the  Earth,  for  example  a runway.  In  this  case,  the  origin  of  the  runway  coordinate 
system  is  usually  located  at  the  runway  threshold  with  the  xrwy  axis  aligned  with  the  centerline  and  pointed 
down  the  runway,  the  yrwy  axis  to  the  right  of  centerline,  and  either  an  hlwy  axis  pointing  up  or  a zrwy  axis 
pointing  into  the  ground.  Another  example  of  an  LRC  frame  has  its  origin  directly  beneath  the  vehicle  on 
the  surface  of  the  Earth  and  is  oriented  north,  east  and  down  (the  NED  frame).  The  vehicle’s  attitude  is 
often  expressed  relative  to  this  NED  frame.  Many  other  LRC  orientations  are  possible  and,  aside  from  the 
runway  and  NED  frames,  will  require  full  specification  when  models  are  shared. 

The  final  common  coordinate  system,  for  both  aircraft  and  spacecraft,  is  the  body-axis  system.  In  flight 
dynamics  applications,  the  common  convention  is  for  the  :r-axis  to  point  forward  along  the  body  of  the 
vehicle,  the  z-axis  to  point  down,  and  the  y-axis  completing  the  right-hand  rule  out  the  right  side  of  the 
vehicle.  For  most  aircraft,  this  is  straightforward  and  vehicle  subsystem  models  (aerodynamics,  inertial 
properties,  landing  gear,  propulsion  systems)  are  defined  in  these  body  axes.  Often,  however,  geometric 
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properties  such  as  location  of  the  CM,  landing  gear,  and  other  vehicle  geometries  are  defined  in  a vehicle 
reference  system,  used  for  mechanical  layout,  in  which  the  x and  z axes  are  reversed  in  direction  and  with 
an  origin  located  off  the  vehicle  (typically  a point  forward  and  below)  but  in  the  plane  of  symmetry  (if  one 
exists). 

Aerodynamic  models  have  a number  of  coordinate  systems  for  measuring  reaction  forces  and  moments, 
stability,  and  other  quantities;  they  are  beyond  the  scope  of  this  study  as  the  conventional  body  axis  has 
been  used  almost  exclusively  for  these  vehicle  models. 

B.4  Gravitation  models 

This  section  describes  four  types  of  gravitational  models  commonly  used  in  aircraft  and  space  vehicle  simu- 
lations representing  increasing  fidelity  in  modeling  the  value  of  gravitation  as  a function  of  ECEF  position. 

In  this  report,  we  keep  the  same  distinction  as  the  WGS-84  document  (reference  [7])  where  “gravitation” 
refers  to  the  attraction  (force  per  unit  mass)  between  the  vehicle  and  the  Earth  (and  Sun  and  Moon,  in 
orbital  check-cases  involving  these  effects);  “gravity”  is  the  net  acceleration  involving  Earth’s  gravitation, 
summed  with  centrifugal  acceleration  due  to  rotation  of  the  Earth,  that  yields  the  familiar,  at  rest,  sea- level 
accelerations  on  the  order  of  32.2  ft/s2  or  9.81  m/s2. 

B.4.1  Constant  gravity 

For  the  simplest  gravity  model  (which  combines  gravitation  and  centrifugal  accelerations),  the  standard 
unit  of  acceleration  due  to  gravity  at  the  Earth’s  surface  (g)  is  defined  in  SI  units  (9.80665  m/s2);  the 
English  truncated  approximation  often  cited  is  32.174  ft/s2.  These  values  should  be  used  as  a constant 
where  indicated. 


B.4. 2 Inverse  square  gravitation 


The  simplest  gravitation  model  which  could  be  considered  for  the  propagation  of  a space  vehicle  is  the  model 
first  proposed  by  Sir  Isaac  Newton  in  which  the  attractive  force  on  each  of  two  masses  is  given  by 


F\ 

F2 


Gmim2  (^R2  ~ Rij 
\R2~Rl\3 
Gmim2  (^R±  — R2 ^ 


(16) 


where  R±  and  R2  are  the  positions  of  each  of  two  point  masses  m\  and  m2  respectively  and  G is  the  universal 
gravitational  constant. 

The  force  is  directed  so  as  to  represent  an  equal  and  opposite  attraction  between  the  point  masses,  and  its 
magnitude  is  proportional  to  the  product  of  the  masses  divided  by  the  square  of  the  distance,  hence  the 
“inverse  square”  nomenclature. 
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In  a two-mass  system,  it  is  possible  to  solve  equation  16  exactly  yielding  the  familiar  Keplerian  solutions. 
The  differential  equations 


= 


Gm2  (r2  -Ri) 


\R2-Ri\3 


Gm- 


R2  = 


(til  - R2) 


\R2-Ri\3 


(17) 


can  be  further  simplified  to  the  central  force  problem  described  by 

R 


R = — // 


l^l3 


(18) 


t o 

where  R represents  the  position  of  m2  with  respect  to  their  common  center  of  mass,  and  /i  = G (mi+^t2)2  ■ 
For  the  purposes  of  simulating  a vehicle  m2  in  the  gravitational  well  of  a planet  mi,  the  simplification 
mi  >>>  m2  gives 

fi  = Gmi  (19) 


B.4.3  Spherical  harmonic  gravitation 

The  inverse-square  gravitation  model  relies  on  the  fact  that  the  Earth  is  nearly  spherical  and  assumes  it 
is  of  constant  density,  and  thus  its  gravitational  potential  is  approximately  the  same  as  if  the  entire  mass 
of  the  Earth  were  concentrated  at  its  center.  The  mathematics  of  spherical  harmonic  expansions  provides 
a convenient  model  for  the  gravitational  potential  of  the  Earth  with  its  flattening  at  the  poles  and  other 
non-spherical  irregularities  and,  for  higher-order  models,  captures  localized  differences  in  the  Earth’s  density. 

Gravitational  fields  are  typically  developed  and  expressed  in  spherical2  coordinates. 

The  coordinate  frames  in  which  the  fields  are  developed  are  typically  planet-fixed,  that  is,  fixed  with  respect 
to  the  planetary  body  and,  therefore,  are  generally  non-inertial. 

The  basic  formulation  of  the  spherical  harmonic  expansion  of  a potential  function  is  given  in  references 

[10,11]: 


U(r,  A,0) 


°°  n { R \ n 

-^2^2  ( — ) Pn,m(sin(/))(Cn}rn  cos m\  + S„imsinmA) 
n— 0 m= 0 ' 


(20) 


where  (r,  A,  (j>)  are  the  geocentric  coordinates  radius,  longitude,  and  latitude  (Figure  13),  is  the  gravita- 
tional parameter  (//  = GM );  n and  m are  model  degree  and  order;  R.  is  the  mean  equatorial  radius  of  the 
gravitational  body;  P„,m  is  the  fully  normalized  associated  Legendre  function  of  degree  n and  order  m;  and 
Cn,m  and  Sn,m  are  fully  normalized  unit-less  gravitation  coefficients  that  are  related  to  the  mass  distribution 
of  the  body  [10, 12].  The  overhead  bar  denotes  a coefficient  that  is  fully  normalized  using  the  relationship 


f Cn,m  \ = I ( Tl+m)\  r Cn,m  ) 

\ Sntm  J y (2  - S0m){2n  + l)(n  - m)\  \ Sn,m  J 


(21) 


2 Here  the  term  spherical  means  coordinates  based  on  a spherical  body  as  opposed  to  an  oblate  elliptical  body  (i.e.,  geocentric 
vs.  geodetic  coordinates). 
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where  Som  = 1 when  m = 0,  and  Som  = 0 when  to  0. 

The  zero-degree  term  (Coo)  represents  the  spherical  surface  upon  which  the  higher  degree  terms  are  imposed. 
It  is  unity  by  definition  (Coo  = 1)-  All  Sn^m  terms  vanish  for  m = 0 because  the  sine  term  in  equation  20 
vanishes  when  to  = 0.  It  can  be  shown  [10, 13]  that  the  location  of  the  CM  (x,  y , z ) of  the  gravitational  body 
is  related  to  the  un-normalized  first-degree  coefficients  by 

x = RCit  i 

y = RSi,i  (22) 

z = RC  ij0 


The  normal  practice  is  to  define  the  spherical  coordinate  system  such  that  the  origin  is  located  at  the  CM. 
Therefore,  the  first-degree  terms  Cio,  Cn,  and  5n  all  equal  zero.  With  these  definitions  of  the  zero-degree 
and  first-degree  terms,  the  spherical  harmonic  potential  model  becomes 


U{r,X,<t>)  = — 
r 


1 + ^2  ^2  f — ) Pn,m{sin(/))(Cn}m  costoA  + Sn}m  sin toA) 

n— 2 m— 0 ' 


(23) 


An  important  special  case  of  the  spherical  harmonic  gravitation  model  is  the  J2  simplification.  The  coefficient 
C2fi  reflects  the  oblateness  of  the  Earth  and  dominates  the  higher  order  terms.  Many  simulations  only  need 
the  accuracy  provided  by  these  first  two  terms  of  the  spherical  harmonic  expansion,  and  such  implementations 
are  often  called  the  J2  gravitation  model.  The  name  arises  from  the  equivalence  between  the  un-normalized 
C2,o  and  the  previous  historical  harmonic  parameter  J2  = — C^o- 

With  this  substitution,  equation  23  reduces  to 


U(r,4) 


y 

r 


1 - y (3  sin2  (/)-!) 


(24) 


which  shows  that  the  gravitation  potential  varies  only  with  latitude  and  radius  from  the  Earth’s  center  when 
using  only  the  first  non-zero  harmonic  term  for  an  oblate  spheroid. 


B.4.4  Gravitational  effects  on  the  vehicle 

The  effect  of  gravitation  has  an  important  effect  on  any  motion  through  the  known  universe.  Given  a grav- 
itational potential  function  U,  such  as  equation  23  for  an  ellipsoidal  Earth,  the  corresponding  gravitational 
acceleration  field  can  be  viewed  as  the  gradient  of  U.  In  general,  we  write  the  equation  for  the  gravitational 
acceleration  A as 


A = VU(R) 


(25) 


Translational  effects  — inverse-square  For  the  inverse-square  approximation,  calculating  the  gravita- 
tional acceleration  components  in  the  ECI  frame  is  straightforward  because  we  can  write  U simply  in  terms 
of  the  x,  y,  and  z components  of  the  inertial  position  R and  arrive  at  the  gravitational  potential  function  for 
the  inverse-square  law  model: 


t/(x,y,z) 


\/x2  + y2  -(-  z2 


(26) 
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Differentiating  equation  26  gives  acceleration  for  the  inverse-square  gravitation  approximation: 


A = 


(x2  + y2  + z2)5 


(27) 


Translational  effects  — J2  model  Since  most  simulation  tools  perform  integration  in  a rectangular 
inertial  frame,  equation  23  can  transformed  from  geocentric  spherical  to  rectangular  ECI  coordinates  using 
the  following  conversions  (similar  to  equations  11): 


r = i/(x2  + y2  T z2 ) 

(j)  = sin_1(-) 

r 

(28) 

By  substituting  equations  28  into  equation  24  and  taking  the  derivatives  of  U with  respect  to  x,  y,and  z (as 
in  reference  [14])  we  obtain  the  scalar  accelerations  in  the  ECI  frame: 


y = 


^r3 

y 

^r3 

z 

"Mis 


1 - 


1 - 


1 - 


3./2re2(5z2  — r2) 

2 r4 

3J2re2(5z2  — r2) 

2 r4 

3</2re2(5z2  — 3r2) 
2 r* 


(29) 

(30) 

(31) 


where  re  is  the  equatorial  radius  of  the  reference  WGS-84  ellipsoid. 

Note  that  when  state  propagation  is  performed  in  the  ECI  (or  other  inertial)  frame,  the  centrifugal  acceler- 
ation contribution  to  Earth’s  rotation  is  not  explicitly  included. 


Translational  effects  — higher-order  harmonics  There  is  significantly  more  complexity  required  to 
compute  the  gradient  of  the  harmonic  version  of  the  potential  defined  by  equation  20.  Since  the  potential 
is  defined  in  terms  of  planet-fixed  coordinates,  and  the  derivatives  must  be  taken  with  respect  to  inertial 
Cartesian  coordinates,  it  is  essential  to  have  ready  access  to  the  time  varying  transformation  M defined  in 
equation  15.  We  can  write  the  equation  for  inertial  translational  acceleration  as 

ATT 

A = Mt  (Mi?inertial)  (32) 

^'-^pfixed 

and  similarly, 

Hinertial  = MTHpflxedM  (33) 

where  i?pfiXed  is  the  Cartesian  planet-fixed  position,  i?;nertiai  is  the  inertial  Cartesian  position,  -ffmertiai  is  the 
matrix  of  second  derivatives  of  U with  respect  to  inertial  Cartesian  coordinates  and  Hpdxed  is  the  matrix  of 
second  derivatives  of  U computed  with  respect  to  Earth-fixed  Cartesian  coordinates. 
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Rotational  effects  of  gravitation.  The  other  important  effect  of  gravity  on  orbiting  vehicles  is  the  torque 
exerted  by  the  gravity  gradient,  which  can  be  computed  from  Hinertiai  as  defined  in  equation  33.  This  effect 
is  usually  omitted  from  atmospheric  flight  simulations  but  is  important  for  orbital  flight  simulation.  Orbital 
flight  simulations  are  generally  performed  with  higher-order  harmonic  models,  so  only  that  gravitational 
potential  is  considered  here. 

It  is  convenient  to  use  the  inertia  tensor  / as  defined  in  equations  3 and  4 and  a gradient  approximation  for 
gravity  near  the  vehicle  to  provide  an  accurate  estimate  of  torque  due  to  gravity  gradient. 

Note  that  the  inertia  tensor  is  commonly  expressed  in  the  body-fixed  frame,  and  we  often  wish  to  express 
torque  in  the  body  frame.  To  this  end,  we  transform  the  gravity  gradient  matrix  from  the  inertial  frame  to 
spacecraft  body-fixed  coordinates  using  a similarity  transformation 

G = BHinertialBT  (34) 

where  B is  the  inertial  to  body-fixed  transformation  matrix. 

The  gravitational  torque  acting  on  the  spacecraft  can  then  be  expressed  as 

t=  [ pxGpdm  (35) 

where  the  vector  p is  defined  as  in  equation  5. 
as 

/ G2,3(Izz  - Iyy)  - 
T = I Gl^(IXx  — Izz)  + 

V Gl,2\Iyy  I xx  ) 

B.5  Atmosphere  models 

B.5.1  U.S.  Standard  Atmosphere  1976 

The  U.S.  Standard  Atmosphere  1976  model  [6] 
ios.  This  model  can  be  implemented  as  linear  interpolation  of  the  ID  tables  printed  in  the  source  document 
with  ambient  pressure,  temperature  and  density  as  a function  of  either  geometric  altitude  ( h ) or  geopotential 
height  (Z).  A more  accurate  implementation  is  to  realize,  in  software,  the  non-linear  numerical  equations 
from  [6]  used  to  generate  the  tables  found  in  the  report. 

B.5. 2 Marshall  Engineering  Thermosphere  Model  (MET) 

The  Marshall  Engineering  Thermosphere  (MET)  model  is  an  empirical  model  whose  coefficients  were  ob- 
tained from  satellite  drag  analyses.  It  is  a static  diffusion  model  and  is  essentially  the  Smithsonian’s  Jacchia 
1970  model  (ref  [15])  with  two  additions  from  the  Jacchia  1971  model  (ref  [16]).  In  addition  to  thermo- 
spheric densities  and  temperatures,  the  well-documented  code  provides  several  often-used  parameters  like 
gravitational  acceleration  and  specific  heat.  MET  was  developed  at  NASA’s  Marshall  Space  Flight  Center 
(MSFC)  in  Huntsville  primarily  for  engineering  applications  of  low  Earth  orbiting  spacecraft. 

The  MET  model  was  developed  to  represent,  in  so  far  as  practical  for  engineering  applications,  the  variability 
of  the  ambient  mass  density  at  orbital  altitudes.  It  is  the  standard  neutral  atmospheric  density  model  used 
for  control  and  lifetime  studies  involving  all  orbiting  spacecraft  projects. 


The  torque  can  be  expressed  in  terms  of  elements  of  I and  G 
G\^IXy  + — Iyz{Gsy3  — G2>2) 

G2ptlXy  — GipIyZ  — IxziGip  — Gs'Z) 

G2^Ixz  + Gi^Iyz  — Ixy{G2,2  — Gup) 

Model 

is  used  for  the  majority  of  the  atmospheric  check-case  scenar- 
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Inputs  to  the  model  are  time  (year,  month,  day,  hour,  and  minute),  position  (altitude  and  geographic  latitude 
and  longitude),  the  previous  day’s  solar  radio  flux  (-F10.7),  the  centered  solar  radio  flux  averaged  over  6 solar 
rotations  (F10.7)  and  the  ap  index  at  6 to  7 hours  before  the  time  in  question  (for  some  studies  the  daily 
planetary  geomagnetic  index,  ap,  may  be  used  instead  of  the  3-hourly  ap  value). 

With  these  inputs  the  exospheric  temperature  can  be  calculated.  It  should  be  stressed  that  in  the  original 
development  of  the  model,  the  prime  objective  was  to  model  the  total  neutral  density  of  the  thermosphere  by 
adjusting  temperature  profiles  until  agreement  between  modeled  and  measured  total  densities  was  achieved. 
Thus,  agreement  between  modeled  and  measured  temperature  is  not  always  achieved.  Thomson-scatter 
temperature  measurements  generally  show  that  the  temperature  lags  the  density  by  a couple  of  hours, 
whereas  in  the  MET  model  the  temperature  and  density  are  in  phase. 

With  the  exospheric  temperature  specified,  the  temperature  can  be  calculated  for  any  altitude  between 
the  lower  boundary  (90  km)  and  the  upper  level  (2500  km)  of  the  model  from  an  empirically  determined 
temperature  profile.  The  density  for  all  points  on  the  globe  at  90  km  altitude  is  assumed  constant,  and 
mixing  prevails  to  105  km.  Between  these  two  altitudes,  the  mean  molecular  mass  varies  as  a result  of  the 
dissociation  of  molecular  to  atomic  oxygen.  At  120  km  altitude,  the  ratio  of  atomic-to-molecular  oxygen  is 
assumed  to  be  1.5.  Density  between  90  and  105  km  is  calculated  by  integration  of  the  barometric  equation. 
For  altitudes  above  105  km  the  diffusion  equation  for  each  of  the  individual  species  (O2,  O,  N2,  He  and  Ar)  is 
integrated  upwards  from  the  105-km  level.  For  hydrogen,  the  integration  of  the  diffusion  equation  proceeds 
upwards  from  500  km  altitude.  The  total  mass  density  is  calculated  by  summing  the  individual  specie  mass 
densities. 

The  total  density  is  then  further  modified  by  the  effects  of  the  seasonal-latitudinal  density  variation  of 
the  lower  thermosphere  below  170  km  altitude  and  seasonal-latitudinal  variations  of  helium  above  500  km. 
These  two  effects  have  been  incorporated  in  the  MET  model  using  equations  developed  by  Jacchia  for  his 
1971  thermospheric  model. 

The  final  output  of  the  MET  model  is  total  mass  density,  temperature,  pressure,  individual  specie  number 
densities,  mean  molecular  weight,  scale-height,  specific  heats,  and  the  local  gravitational  acceleration. 

The  total  mass  density,  the  temperature,  and  the  individual  species  all  have  the  same  phase  variation  in 
the  MET  model  (i.e. , they  all  maximize  at  the  same  local  time).  For  some  studies  involving  the  effects  of 
various  species  on  an  orbiting  spacecraft,  it  may  be  required  to  use  the  MSIS  (Mass  Spectrometer  Incoherent 
Scatter)  model  [17]  if  accurate  phases  of  the  various  species  are  required. 

In  this  study,  several  variants  of  the  MET  model  were  used  (MET95,  MET98,  and  MET07). 

The  models  are  described  in  references  NASA  Marshall  Engineering  Thermosphere  Model  [18],  An  Im- 
provement in  the  Numerical  Integration  Procedure  used  in  the  NASA  Marshall  Engineering  Thermosphere 
Model  [19],  and  NASA  Marshall  Engineering  Thermosphere  Model  - Version  2.0  [20].  Availability  of  these 
models  vary,  but  can  be  requested  from  the  Natural  Environments  Branch  (EV44)  at  NASA  Marshall  Space 
Flight  Center. 

B.6  Simulation  Tools  Description 

A brief  description  of  the  participating  simulation  tools  is  given  in  this  section. 

B.6.1  JEOD/Trick  (JSC) 

The  Johnson  Space  Center  (JSC)  Engineering  Orbital  Dynamics  (JEOD)  is  a suite  of  models  needed  to 
propagate  the  6-DOF  states  of  one  or  more  rigid  vehicles  in  the  orbital  or  interplanetary  environment. 
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The  software  models  vehicle  dynamics,  environment,  and  interactions  and  provides  necessary  math  and 
software  utilities  to  work  with  a simulation  engine.  “Trick”  is  a generic  simulation  tool  which  provides  the 
infrastructure  to  define,  initialize,  and  run  the  simulation  model  and  log  and  display  its  output.  JEOD  and 
Trick  leverage  a common  history,  which  enables  an  integrated  simulation  framework  for  orbital  vehicles. 

JEOD  was  employed  for  the  orbital  check-cases;  it  used  a Runge-Kutta  fourth-order  integration  method 
with  a 1.0-sec  time  step.  Dynamic  Aerospace  Vehicle  Exchange  Markup  Language  (DAVE-ML)  models  were 
translated  into  source  code  by  hand. 

B.6.2  LaSRS++  (LaRC) 

The  Langley  Standard  Real-Time  Simulation  in  C++  (LaSRS++)  is  an  object-oriented  framework  for  con- 
struction of  aerospace  vehicle  simulations  [21].  LaSRS++  simulations  support  desktop  analysis,  hardware- 
in-the-loop  simulations,  and  high-fidelity,  human-in-the-loop  simulators.  Projects  using  LaSRS++  have 
modeled  commercial  transport  aircraft,  military  fighters,  advanced  concept  aircraft,  launch  vehicles,  plane- 
tary landers,  crewed  spacecraft,  planetary  aircraft,  and  unmanned  aerial  vehicles. 

DAVE-ML  models  of  the  F-16  and  two-stage  rocket  were  interrogated  at  run-time  using  a customized  library 
developed  at  LaRC.  The  simpler  models  (ISS,  brick,  and  spheroids)  were  built  in  C++  by  hand. 

LaSRS++  was  employed  for  both  the  atmospheric  and  orbital  check-cases.  For  all  cases,  the  integration 
methods  used  were  the  same,  but  were  customized  depending  upon  which  state  was  being  propagated,  as 
given  in  Table  20. 

Frame  rates  varied  depending  on  the  check-case,  as  given  in  Table  21.  Frame  rates  were  selected  to  minimize 
integration  error  differences  with  other  simulations  using  Runge-Kutta  integration  methods.  (LaSRS-| — b 
simulations  are  normally  operated  with  frame  rates  of  100  Hz  or  less.) 

Table  20.  Integration  Method  for  LaSRS++  Check-case  Implementations 


States 

Method 

Translational  velocity 
Position 

Angular  velocity 
Quaternion  Attitude 

Second-order  Adams-Bashforth 
Second-order  Taylor  series 
Second-order  Adams-Bashforth 
Local  linearization  algorithm  [22] 
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Table  21.  Frame-rates  Used  in  LaSRS++  Check-case  Implementations 


Check-case 

Frame-rate  (1/s) 

Atmospheric  Cases  1 10 

500 

Atmospheric  Cases  11,  13  - 16 

100 

Atmospheric  Case  12 

200a 

Atmospheric  Case  17 

l,000b 

Orbital  Cases  2 - 6B 

500 

Orbital  Case  6C 

10,000c 

Orbital  Case  6D 

40,000c 

Orbital  Case  7A  - 8B 

500 

Orbital  Case  9A  - 9D 

2,000c 

Orbital  Case  10A  - Full 

500 

a supersonic  vehicle  dynamics  not  stable  at  100  Hz 
b better  matches  POST  II  timing  of  engine  cutoff 
c higher  frame-rate  better  handles  square  pulse  inputs 


B.6.3  MAVERIC  (MSFC) 

Marshall  Aerospace  Vehicle  Representation  in  C (MAVERIC)  is  a low-  to  high-fidelity  3-DOF/6-DOF  vehicle 
flight  simulation  program  developed  at  MSFC,  written  primarily  in  the  C and  C++  programming  languages. 
MAVERIC  was  designed  to  be  generic  and  data-driven  and  can  provide  for  the  rapid  development  of  an  end- 
to-end  vehicle  flight  simulation  which  starts  at  launch  and  ends  at  “wheel  stop”  after  landing  (or  splashdown) . 
The  vehicle  simulation  models  are  layered  upon  a set  of  foundational  software  called  TFrames.  TFrames  is 
a time-based  differential  equation  solver  environment  and  is  public-domain  software.  TFrames  provides  an 
environment  for  developing  a dynamic  simulation  that  insulates  the  simulation  developer  from  the  tedious 
programming  details  associated  with  numerical  integration,  discrete  data  sampling,  table  look-ups,  etc. 
High-level  routines  provide  convenient  interfaces  between  the  simulation  code  and  the  numerical  integration 
engine. 

MAVERIC  was  used  to  exercise  some  but  not  all  of  the  atmospheric  and  orbital  check-cases;  it  used  a 
Runge-Kutta  fourth-order  integration  method  with  a 0.1-sec  time  step.  DAVE-ML  models  were  translated 
into  source  code  by  hand. 

B.6.4  POST  II  (LaRC) 

The  Program  to  Optimize  Simulated  Trajectories  II  (POST  II)  is  a generalized  point  mass,  discrete  parameter 
targeting,  and  optimization  program.  POST  II  provides  the  capability  to  target  and  optimize  point  mass 
trajectories  for  multiple  powered  or  un-powered  vehicles  near  an  arbitrary  rotating,  oblate  planet.  POST  II 
has  been  used  successfully  to  solve  a wide  variety  of  atmospheric  ascent  and  reentry  problems,  as  well 
as  exo-atmospheric  orbital  transfer  problems.  The  generality  of  the  program  is  evidenced  by  its  multiple 
phase  simulation  capability  which  features  generalized  planet  and  vehicle  models.  This  flexible  simulation 
capability  is  augmented  by  an  efficient  discrete  parameter  optimization  capability  that  includes  equality  and 
inequality  constraints. 

POST  II  increases  the  trajectory  simulation  capability  of  the  original  POST  computer  code  and  provides  a 
state-of-the-art  software  tool.  POST  II  contains  many  basic  models  (such  as  atmosphere,  gravity,  propulsion, 
and  navigation  system  models)  that  are  used  to  simulate  a wide  variety  of  launch,  orbital,  and  entry  missions. 
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As  indicated  above,  POST  II  can  support  multiple  vehicles  in  a single  simulation,  each  with  independently 
defined  environments,  vehicle,  and  attracting  body  characteristics.  Thus,  each  vehicle  can  have  its  own  GNC 
system  for  completely  independent,  on-board  autonomy.  Conversely,  effects  of  multi-body  and  interaction 
forces  that  depend  on  the  relationship  of  one  vehicle  to  another  can  be  included. 

Additionally,  POST  II  can  support  3-DOF  and  6-DOF  trajectories  within  the  same  simulation;  not  only  can 
each  vehicle  trajectory  support  different  DOFs,  but  also  each  trajectory  segment  within  a given  simulation 
can  be  either  3-DOF  or  6-DOF. 

POST  II  was  employed  against  most  of  the  atmospheric  and  orbital  check-cases;  it  used  a Runge-Kutta 
fourth-order  integration  method  for  all  of  the  cases  but  the  frame-rate  varied  depending  on  the  case  as 
shown  in  Table  22 

The  DAVE-ML  models  were  translated  into  source  code  by  hand  except  for  the  F-16  GNC  models,  which 
were  interrogated  at  run-time  using  a customized  library  developed  at  LaRC. 

Table  22.  Frame-rates  Used  in  POST  II  Check-case  Implementations 


Check-case 

Frame-rate  (1/s) 

Atmospheric  Cases 

100 

Orbital  Cases  2 - 6B,  7 

10 

Orbital  Case  6C  & 6D 

10a 

Orbital  Case  8 - FULL 

20 

a 1,000  Hz  during  thruster  burns 


B.6.5  VMSRTE  (ARC) 

The  Vertical  Motion  Simulator  Real-Time  Environment  (VMSRTE)  provides  a flexible  environment  for  man- 
machine  research,  capable  of  rapid  prototyping  and  run-time  reconfiguration  of  vehicle  models,  simulator 
hardware,  and  the  surrounding  laboratory,  combined  with  efficient  operation  and  data  collection.  It  offers 
source-level  debugging  and  the  ability  to  alter  simulation  and  facility  variables  during  program  execution. 
A standardized  framework  streamlines  simulation  development  by  providing  elements  that  are  common 
to  most  simulations.  A wide  variety  of  vehicles  have  been  simulated  on  the  Vertical  Motion  Simulaton 
(VMS)  including  rotorcraft,  Vertical  and/or  Short  Take-off  and  Landing  (V /STOL)  and  conventional  aircraft, 
spacecraft,  and  airships.  Research  topics  have  also  spanned  a wide  range,  including  handling  qualities, 
guidance  and  display  development,  flight  control  design,  concept  demonstration  and  evaluation,  human- 
factors,  and  simulation  fidelity  requirements. 

VMSRTE  was  employed  for  some  of  the  atmospheric  check-cases;  it  used  an  Adams-Bashforth  second-order 
integration  method  [23]  with  a 0.01-sec  time  step.  DAVE-ML  models  were  translated  into  an  Ames-unique 
function  table  processor  input  deck  and  FORTRAN  code  snippets  for  access  using  a customized  Perl  script. 

B.6.6  Core  (AFRC) 

All  current  simulations  at  NASA  Armstrong  Flight  Research  Center  (AFRC)  are  based  on  a common  software 
framework,  called  “Core.”  Core  is  used  for  aircraft  simulations  ranging  from  gliders  to  suborbital  vehicles 
and  runs  on  platforms  ranging  from  laptop  computers  to  pilot-in-the-loop  / aircraft-in-the-loop  simulators. 
Core  is  composed  of  standard  models,  mathematical  routines,  a user  interface,  hardware  interfaces,  timing 
routines,  data  recording  and  data  input  subsystems,  external  application  interfaces,  and  other  sharable 
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modules.  Core  is  predominately  written  in  the  C++  computer  programming  language  but  supports  legacy 
FORTRAN  models.  Currently  the  simulators  located  at  AFRC  are  used  for  engineering  analysis  more 
than  for  pilot  training.  Typical  simulation  tasks  include  evaluation  of  new  vehicle  concepts,  control  law 
development  and  validation,  flight  safety  analysis,  mission  planning,  flight  envelope  expansion,  and  post- 
flight data  analysis. 

Core  was  employed  for  some  of  the  atmospheric  check-cases;  it  used  a Runge-Kutta  fourth-order  integration 
method  with  a 0.01-sec  time  step.  DAVE-ML  models  were  interpreted  at  run-time  by  use  of  the  Janus  [24] 
software  library. 

B.6.7  JSBSim  (Open  source) 

JSBSim  is  an  open  source,  high  fidelity,  flight  dynamics  and  control  software  library  written  almost  entirely 
in  C-| — b in  a collaborative,  volunteer  effort  by  a small  team  of  developers.  It  has  been  in  development  since 
1997  and  has  been  incorporated  into  several  larger  simulation  applications,  including  the  FlightGear  open 
source  flight  simulator,  Outerra,  and  OpenEaagles,  and  has  been  used  by  engineers  for  studies  at  major 
aerospace  organizations.  It  can  be  built  and  run  both  as  an  integral  part  of  a larger  simulation  framework 
and  as  a stand-alone  batch  program  on  several  platforms  (Microsoft  Windows,  Apple  Macintosh,  Linux, 
Unix,  etc.).  JSBSim  provides  models  of  general  classes  of  objects  such  as  aerodynamic  models,  flight  control 
system  components,  engines,  mass  properties,  and  so  on,  with  vehicle-specific  characteristics  read  from  a set 
of  configuration  files  in  an  XML  format.  Vehicles  that  have  been  modeled  within  JSBSim  encompass  the 
range  from  a simple  ball  to  gliders,  unmanned  aerial  vehicles,  airships,  airliners,  launch  vehicles,  all  the  way 
to  an  orbital  spacecraft  with  an  extensive  aerodynamic  database,  rocket  propulsion  systems,  and  guidance 
and  control  laws. 

JSBSim  was  exercised  for  the  atmospheric  check-cases;  it  used  a “higher-order”  Adams-Bashforth  integration 
method  at  120  frames  per  simulated  second. 

The  DAVE-ML  files  were  converted  into  the  JSBSim  XML  input  format  by  hand. 


C Check-case  scenario  descriptions 

The  check-case  scenarios  examined  in  this  assessment  are  given  in  tables  presented  in  Volume  I and  repro- 
duced here.  Atmospheric  check-case  14  was  not  completed  due  to  resource  constraints. 

C.l  Atmospheric  scenarios 

For  atmospheric  flight,  a set  of  scenarios  with  increasingly  complex  models  and  initial  conditions  was  agreed 
upon,  as  shown  in  Table  23.  These  models  ranged  from  the  obligatory  dropped  cannonball  to  a two-stage 
rocket  launch. 

Tables  25  through  44  show  the  initial  conditions  for  each  of  the  atmospheric  check-cases. 

In  general,  a 6-DOF  simulation  tool  operated  by  iteratively  using  instantaneous  flight  conditions  such  as 
Mach  number,  angles-of-attack  and  sideslip,  and  control  surface  deflections  (if  any)  to  perform  linear  function 
interpolations  of  multidimensional  aerodynamic  coefficient  data  tables.  These  interpolated  data  typically 
consist  of  non-dimensional  force  and  moment  coefficients  acting  at  or  about  some  fixed  reference  point  in  the 
body-axis  coordinate  frame.  These  aerodynamic  forces  and  moments  were  then  scaled  to  full  value,  added 
to  any  propulsive  forces  and  moments,  and  transferred  to  the  current  CM.  The  resulting  linear  and  angular 
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accelerations  were  then  determined  by  inverting  the  current  mass  tensor.  These  accelerations,  expressed  in 
the  body  axes,  were  (usually)  rotated  into  the  inertial  (ECI)  reference  system,  gravitation  was  added,  and 
the  resulting  six  accelerations  (three  linear,  three  angular)  were  integrated  twice  to  obtain  rates/velocities 
and  attitudes/positions  in  inertial  space.  These  values  were  then  transformed  back  into  ECEF  positions 
to  calculate  Earth-relative  body-axis  velocities,  angles-of-attack  and  sideslip,  velocity  with  respect  to  the 
atmosphere  (for  Mach  number  and  dynamic  pressure),  and  often  the  position  of  the  vehicle  relative  to  other 
Earth-fixed  locations,  e.g.  a runway  or  launch  site. 

Key  parameters  that  were  compared  in  the  resulting  solutions  were  aerodynamic  linear  and  angular  forces 
and  moments,  velocity  in  local  (NED)  and  inertial  frames,  angular  body-axis  rates  relative  to  the  local 
frame,  vehicle  center-of-mass  position  in  geodetic  spherical,  ECEF  rectangular,  and  inertial  rectangular 
coordinates,  vehicle  attitude  relative  to  the  local  frame  (Euler  angles),  local  gravity,  atmospheric  properties 
(density,  ambient  temperatures  and  pressures  and  speed  of  sound),  climb  rate,  Mach  number,  dynamic 
pressure,  and  true  airspeed  (when  recorded).  These  comparison  plots  can  be  found  in  Appendix  D.l. 

The  specific  scenarios  for  each  of  the  atmospheric  check-cases  are  described  below,  along  with  a table  giving 
both  initial  state  values  and  problem  assumptions,  including  the  vehicle  being  simulated,  geodetic  Earth 
model,  atmosphere  model,  and  gravitational  model  to  be  used. 

Position  is  the  initial  position  of  the  CM  of  the  vehicle  in  geodetic  (Earth-centered,  Earth-fixed)  latitude, 
longitude  and  height  above  the  reference  ellipsoid  or  sphere.  Units  are  deg  / deg  / ft  above  reference 
ellipsoid  or  sphere. 

Velocity  is  the  initial  Earth- relative  velocity,  given  in  local  (NED)  axes  in  ft/s,  in  the  order  x-y-z. 

Attitude  is  the  initial  vehicle  orientation,  given  in  spherical  Euler  angles  with  a 3-2-1  rotation  (yaw,  pitch, 
roll)  from  the  geodetic  NED  axes;  they  are  listed  in  reverse  order  to  match  convention:  roll  angle,  pitch 
angle,  and  yaw  angle  in  degrees. 

Rate  is  initial  rotation  rate  presented  in  body-axis  quantities  relative  to  the  inertial  frame  in  order  of  roll, 
pitch  and  yaw  rates  in  deg/s. 

The  duration  of  each  scenario  is  also  specified.  Each  simulation  provider  was  encouraged  to  provide  data 
at  their  chosen  frame-rate  and  to  include  key  atmospheric  and  aerodynamic  parameters,  as  well  as  both 
Earth- fixed  (geodetic)  and  inertial  states  (if  applicable). 

C.1.1  Check-case  1 — dragless  sphere 

The  initial  atmospheric  check-case  scenario  called  for  the  smaller  spheroid  (described  in  Section  B.1.1)  to  be 
dropped  from  an  initial  position  located  30,000  ft  over  the  Equator/Prime  Meridian  intersection.  As  specified 
in  Table  25,  its  initial  linear  velocity  should  have  matched  the  Earth’s  eastward  rotation  rate  at  that  altitude 
so  that  it  was  initially  motionless  (in  a linear  sense)  with  respect  to  the  still  atmosphere;  however,  it  should 
have  had  zero  inertial  rotation;  thus  it  had  a small  residual  rotation  relative  to  the  Earth  below  and  the 
atmosphere  surrounding  it. 

The  sphere’s  orientation  was  chosen  such  that  the  body  a;-axis  was  pointed  north,  the  body  0-axis  was 
initially  pointed  down,  with  the  body  y- axis  completing  the  orthogonal  right- hand-rule  by  pointing  east. 
Thus  the  vehicle  would  have  had  a small  amount  of  ‘roll  rate’  with  respect  to  the  rotating  Earth. 

The  sphere  is  imagined  to  have  no  reaction  with  the  atmosphere  - no  damping,  and  no  drag;  it  will  accelerate 
downward  toward  the  ellipsoidal  Earth  in  response  to  second- harmonic  (J2)  gravitation  as  a function  of  its 
geometric  height  (described  in  Section  B.4.3).  This  is  achieved  by  setting  the  coefficient  of  drag  ( Cd ) in 
Table  2 to  zero  for  this  scenario. 
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Table  25.  Initial  Conditions  for  Atmospheric  Scenario  1 


Scenario 

1:  Dragless  sphere 

Vehicle 

Dragless  sphere 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

30  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[0,  0,  30000] 

[0,  0,  0] 

[0,  0,  0] 

[-0.004178073,  0,  0] 

Notes 

Cd  set  to  zero 

C.1.2  Check-case  2 dragless  tumbling  brick 

The  second  atmospheric  check-case  scenario  called  for  the  brick  ‘vehicle’  (described  in  Section  B.1.3)  to 
be  dropped  from  the  same  initial  position  as  as  the  sphere  in  atmospheric  scenario  1 (30,000  ft  over  the 
Equator/Prime  Meridian  intersection).  Its  initial  linear  velocity  should  also  have  matched  the  Earth’s 
eastward  rotation  rate  at  that  altitude. 

The  brick’s  orientation  was  chosen  such  that  the  body  x-axis  (aligned  with  the  longest  dimension)  was 
pointed  north,  the  body  2-axis  (shortest  dimension)  was  initially  pointed  down,  with  the  body  y-axis  (medium 
dimension)  completing  the  orthogonal  right-hand-rule  by  pointing  east. 

The  initial  rotation  rate  of  the  brick  about  each  axis,  specified  in  Table  26,  was  such  that  the  inertial  rates 
were  10,  20,  and  30  deg/s,  respectively.  Table  26  gives  these  rates  relative  to  the  rotating  Earth,  so  a smaller 
value  for  ‘roll  rate’  is  specified. 

The  brick  was  imagined  to  have  no  reaction  with  the  still  atmosphere  - no  rotational  damping,  no  lift,  and 
no  drag;  it  would  accelerate  downward  toward  the  rotating  ellipsoidal  Earth  in  response  to  second-harmonic 
(J2)  gravitation  as  a function  of  its  geometric  height.  This  was  achieved  by  setting  all  the  aerodynamic 
coefficient  values  in  Table  5 to  zero  for  this  scenario. 
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Table  26.  Initial  Conditions  for  Atmospheric  Scenario  2 


Scenario 

2:  Tumbling  brick  with  no  damping  or  drag 

Vehicle 

Dragless  rotating  brick 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

30  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[0,  0,  0] 

[0,  0,  0] 

[0,  0,  0] 

[9.995821927,  20,  30] 

Notes 

CiT , Cmq , Cnr  set  to  zero 

C.1.3  Check-case  3 dragless  tumbling  brick  with  aerodynamic  damping 

This  atmospheric  scenario  was  a repeat  of  the  previous  one,  except  the  brick’s  aerodynamic  damping  was 
turned  on  (still  no  lift,  drag  or  sideforce  was  modeled). 

The  initial  rotation  rate  should  start  to  damp  out  as  the  velocity  of  the  vehicle  relative  to  the  still  atmosphere 
(airspeed)  increased. 


Table  27.  Initial  Conditions  for  Atmospheric  Scenario  3 


Scenario 

3:  Tumbling  brick  with  damping  but  no  drag 

Vehicle 

Dragless  rotating  sphere  with  aero  damping 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

30  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[0,  0,  0] 

[0,  0,  0] 

[0,  0,  0] 

[9.995821927,  20,  30] 

Notes 

Cd  set  to  zero 

C.1.4  Check-case  4 sphere  dropping  over  non-rotating,  spherical  Earth 

This  scenario  involved  the  sphere  from  atmospheric  scenario  1 being  dropped  from  the  same  altitude  above 
the  Earth.  However,  in  this  scenario,  the  sphere  had  drag  (nominal  value  of  Cd  given  in  Table  2),  was 
rotating  about  its  body  axes  relative  to  the  Earth  at  10,  20,  and  30  deg/s,  respectively,  and  the  Earth  was 
modeled  as  a round,  non-rotating,  sphere.  The  gravitational  model  used  should  have  been  the  inverse  square 
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law  given  in  Section  B.4.2  rather  than  the  J2  harmonic  gravity  model  used  in  the  previous  scenarios,  as  given 
in  Table  28. 


Table  28.  Initial  Conditions  for  Atmospheric  Scenario  4 


Scenario 

4:  Sphere  with  round  non-rotating  Earth 

Vehicle 

Sphere  with  constant  Cd 

Geodesy 

Round  non-rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

inverse  square 

Duration 

30  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[0,  0,  30000] 

[0,  0,  0] 

[0,  0,  0] 

[10,  20,  30] 

C.1.5  Check-case  5 — sphere  dropping  over  rotating,  spherical  Earth 

In  this  scenario,  the  same  sphere  with  drag  is  dropped  as  in  the  previous  scenario,  but  in  this  check-case, 
the  round  Earth  was  rotating.  The  spherical  vehicle  had  the  same  initial  rotation  rate  relative  to  inertial 
space,  but  with  the  Earth  rotating,  the  Earth-relative  rotation  had  the  small  bias  in  the  roll  axis,  as  given 
in  Table  29. 


Table  29.  Initial  Conditions  for  Atmospheric  Scenario  5 


Scenario 

5:  Sphere  with  round  rotating  Earth 

Vehicle 

Sphere  with  constant  Cd 

Geodesy 

Round  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

inverse  square 

Duration 

30  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[0,  0,  30000] 

[0,  0,  0] 

[0,  0,  0] 

[9.995821927,  20,  30] 

C.1.6  Check-case  6 sphere  dropping  over  rotating,  ellipsoidal  Earth 

This  check-case  (defined  in  Table  30)  was  a repeat  of  the  first  check-case  (“Check-case  1 - dragless  sphere” 
scenario),  except  the  sphere  in  this  case  had  a non-zero  drag  coefficient  (given  in  Table  2). 
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Table  30.  Initial  Conditions  for  Atmospheric  Scenario  6 


Scenario 

6:  Sphere  with  ellipsoidal  rotating  Earth 

Vehicle 

Sphere  with  constant  Cd 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

30  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[0,  0,  30000] 

[0,  0,  0] 

[0,  0,  0] 

[-0.004178073,  0,  0] 

C.1.7  Check-case  7 sphere  dropping  through  a steady  wind  field 

This  scenario  (given  in  Table  31)  was  identical  to  the  previous  check-case  except  the  addition  of  a constant 
20  ft/s  wind  coming  from  the  west,  resulting  in  an  additional  eastward  force  on  the  sphere  as  it  dropped. 
Aside  from  having  a slight  roll  rate,  the  sphere  had  no  initial  motion  with  respect  to  the  Earth’s  surface; 
thus  at  time  t = 0 sec  the  sphere  would  encounter  a sideways  airspeed  component  due  to  the  atmosphere 
moving  eastward  at  a constant  linear  rate. 

Table  31.  Initial  Conditions  for  Atmospheric  Scenario  7 


Scenario 

7:  Sphere  with  steady  wind 

Vehicle 

Sphere  with  constant  Cd 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  steady  20  ft/s  wind  from  due  west 

Gravitation 

J2 

Duration 

30  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[0,  0,  30000] 

[0,  0,  0] 

[0,  0,  0] 

[-0.004178073,  0,  0] 

C.1.8  Check-case  8 — sphere  dropping  through  a varying  wind  field 

Atmospheric  check-case  8 was  similar  to  check-case  7 previously  discussed,  using  the  same  sphere  from 
Section  B.1.1  except  the  wind  velocity  was  a function  of  vehicle  height  above  the  ground,  as  given  in 
Table  32.  The  initial  wind  was  from  the  west  at  70  ft/s  at  30,000  ft,  tapering  to  20  ft/s  from  the  east  at  the 
surface;  however,  the  scenario  ended  before  reaching  the  surface. 
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Table  32.  Initial  Conditions  for  Atmospheric  Scenario  8 


Scenario 

8:  Sphere  with  wind  shear 

Vehicle 

Sphere  with  constant  Cd 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  wind  varies  linearly  with  altitude 

Gravitation 

J2 

Duration 

30  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[0,  0,  30000] 

[0,  0,  0] 

[0,  0,  0] 

[-0.004178073,  0,  0] 

Notes 

twind  = (0.003 h — 20)  ft/s  from  west;  h is  height  MSL  in  ft. 

C.1.9  Check-case  9 eastward  ballistic  flight  of  a sphere 

The  same  sphere  was  put  to  the  test  in  this  scenario  when  it  was  launched  eastward  from  the  Equator/Prime 
Meridian  intersection,  starting  at  sea  level,  with  an  initial  45°  vertical  flight  path  angle  as  specified  in 
Table  33.  The  cannonball  was  oriented  to  point  eastward  with  zero  pitch  and  roll  angles  (with  respect  to 
the  launch  point)  and  with  zero  angular  rate  (again  with  respect  to  the  launch  point). 

Table  33.  Initial  Conditions  for  Atmospheric  Scenario  9 


Scenario 

9:  Sphere  launched  ballistically  eastward  along  Equator 

Vehicle 

Sphere  with  constant  Cd 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

30  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[0,  0,  0] 

[0,  1000,  -1000] 

[0,  0,  90] 

[0,  0,  0] 

Notes 

Initial  velocity  is  y/2,  000  ft/s  aligned  45°  from  vertical,  heading  east;  zero  angular 
rate  relative  to  launch  platform 

C.1.10  Check-case  10  — northward  ballistic  flight  of  a sphere 

In  this  case,  the  sphere  was  launched  northward  from  the  same  spot  as  in  check-case  9 with  the  same  initial 
velocity  and  vertical  flight  path  angle  as  specified  in  Table  34.  In  this  case,  the  sphere’s  body  aj-axis  was 
aligned  northward  (but  still  zero  pitch  or  roll  angle  with  respect  to  the  launch  point).  As  before,  there  was 
no  relative  rotation  with  respect  to  the  launch  point. 
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Table  34.  Initial  Conditions  for  Atmospheric  Scenario  10 


Scenario 

10:  Sphere  launched  ballistically  northward  along  Prime  Meridian 

Vehicle 

Sphere  with  constant  Cd 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

30  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[0,  0,  0] 

[1000,  0,  -1000] 

[0,  0,  0] 

[0,  0,  0] 

Notes 

Initial  velocity  is  i/2,000  ft/s  aligned  45°  from  vertical,  heading  north;  zero  an- 
gular rate  relative  to  launch  platform 

C.1.11  Check  -case  11  — steady  flight  of  a subsonic  aircraft 

This  scenario  utilized  the  F-16  model  described  in  Section  B.1.5  but  the  vehicle  was  to  be  uncontrolled, 
as  this  was  a test  of  how  well  the  vehicle  was  trimmed  for  straight  and  level  flight  for  non-trivial  initial 
conditions  (given  in  Table  35):  positioned  10,000  ft  above  First  Flight  airport  in  Kitty  Hawk,  NC  on  a 
heading  of  45°  true  at  400  KTAS  relative  to  the  still  atmosphere. 

Each  simulation’s  trim  solver  solved  for  zero  linear  and  angular  accelerations  (1  g flight)  at  400  KTAS  at 
10,013  ft  MSL  by  varying  pitch  attitude,  elevator  position,  and  throttle  setting. 

Table  35.  Initial  Conditions  for  Atmospheric  Scenario  11 


Scenario 

11:  Subsonic  winged  flight  (trimmed  straight  & level) 

Vehicle 

Unaugmented  F-16 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

180  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[36.01916667,  -75.67444444,  10013] 

[400,  400,  0] 

[0,  0,  45] 

[0,  0,  0] 

Notes 

Initial  position  is  10,000  ft  above  KFFA  airport  on  a 45°  true  course. 
335.15  KTAS.  Stability  augmentation  off.  Test  of  trim  solution. 
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C.1.12  Check-case  12  — steady  flight  of  a supersonic  aircraft 

This  case  mimicked  the  previous  case,  with  the  exception  of  altitude  and  airspeed  (30,000  ft  MSL  and 
2000  ft/s  (Mach  20),  as  given  in  Table  36).  The  vehicle  was  trimmed  for  level,  un-accelerated  flight  by 
varying  pitch  attitude,  elevator  position,  and  throttle  setting  before  allowing  the  open-loop  vehicle  fly  for 
180  sec. 


Table  36.  Initial  Conditions  for  Atmospheric  Scenario  12 


Scenario 

12:  Supersonic  winged  flight  (trimmed  straight  & level) 

Vehicle 

Unaugmented  F-16 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

180  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[36.01916667,  -75.67444444,  30013] 

[1414.213562,  1414.213562,  0] 

[0,  0,  45] 

[0,  0,  0] 

Notes 

Initial  position  is  30,000  ft  above  KFFA  airport  on  a 45°  true  course.  True 
airspeed  2,000  ft/s.  Stability  augmentation  off.  Test  of  trim  solution. 

C.1.13  Check-case  13.1  — altitude  change  of  a subsonic  aircraft 

This  scenario  started  with  the  same  initial  conditions  as  atmospheric  case  11  (Section  C.1.11)  but  the 
F16-Control  autopilot  was  engaged  (by  setting  autopilotOn_discrete  and  stabilityAugmentationOn_disc  both 
> 0.5).  At  t = +5.0  sec,  a 100-ft  increase  in  commanded  altitude  was  made  (through  control  law  input 
altitudeMsICommand),  and  the  response  of  the  vehicle  to  that  command  change  was  recorded. 
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Table  37.  Initial  Conditions  for  Atmospheric  Scenario  13.1 


Scenario 

13.1:  Maneuvering  flight  of  6-DOF  rigid  aircraft  with  non-linear  aerodynamics 
(subsonic):  Altitude  change 

Vehicle 

F-16  with  simple  autopilot 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

20  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[36.01916667,  -75.67444444,  10013] 

[400,  400,  0] 

[0,  0,  45] 

[0,  0,  0] 

Notes 

Initially  straight  & level,  t = 5 sec:  command  altitude  100-ft  increase. 

C.1.14  Check-case  13.2  — velocity  change  of  a subsonic  aircraft 

This  scenario  started  with  the  same  initial  conditions  as  atmospheric  case  11  (Section  C.1.11)  but  the 
F16-Control  autopilot  was  engaged  (by  setting  autopilotOmdiscrete  and  stabilityAugmentationOmdisc  both 
> 0.5).  At  t — +5.0  sec,  a 5-kt  decrease  in  commanded  equivalent  airspeed  was  made  (through  control  law 
input  equivalentAirspeedCommand),  and  the  response  of  the  vehicle  to  that  command  change  was  recorded. 

Table  38.  Initial  Conditions  for  Atmospheric  Scenario  13.2 


Scenario 

13.2:  Maneuvering  flight  of  6-DOF  rigid  aircraft  with  non-linear  aerodynamics 
(subsonic):  Velocity  change 

Vehicle 

F-16  with  simple  autopilot 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

20  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[36.01916667,  -75.67444444,  10013] 

[400,  400,  0] 

[0,  0,  45] 

[0,  0,  0] 

Notes 

Initially  straight  & level,  t = 5 sec:  decrease  commanded  5 KEAS. 

C.1.15  Check-case  13.3  course  change  of  a subsonic  aircraft 

This  scenario  started  at  the  same  initial  conditions  as  atmospheric  case  11  (Section  C.1.11)  but  the  F16-Control 
autopilot  was  engaged  (by  setting  autopilotOn_discrete  and  stabilityAugmentationOn_disc  both  > 0.5).  At 
t = +15.0  sec,  a 15°  change  in  commanded  heading  to  the  right  was  made  (through  control  law  input 
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trueBaseCourseCommand),  and  the  response  of  the  vehicle  to  that  command  change  was  recorded. 

Table  39.  Initial  Conditions  for  Atmospheric  Scenario  13.3 


Scenario 

13.3:  Maneuvering  flight  of  6-DOF  rigid  aircraft  with  non-linear  aerodynamics 
(subsonic):  Heading  change 

Vehicle 

F-16  with  simple  autopilot 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

30  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[36.01916667,  -75.67444444,  10013] 

[400,  400,  0] 

[0,  0,  45] 

[0,  0,  0] 

Notes 

Initially  straight  & level,  t = 15  sec:  command  15°  right  heading  change. 

C.1.16  Check-case  13.4  lateral  offset  maneuver  of  a subsonic  aircraft 

This  scenario  started  at  the  same  initial  conditions  as  atmospheric  case  11  (Section  C.1.11)  but  the  F16-Control 
autopilot  was  engaged  (by  setting  autopilotOn_discrete  and  stabilityAugmentationOn_disc  both  > 0.5).  At 
t = +20.0  sec,  a 2, 000- ft  lateral  offset  was  commanded  to  the  right  (through  control  law  input  lateral- 
DeviationError),  and  the  response  of  the  vehicle  to  that  command  change  was  recorded. 

In  order  to  exercise  this  maneuver  correctly,  updates  for  the  input  feedback  signal  lateralDeviationError  had 
to  be  calculated  for  each  time  step  by  additional  user-supplied  logic,  based  on  the  aircraft’s  position  relative 
to  the  new  offset  course.  Otherwise,  the  vehicle  would  continue  along  the  initial  correction  heading  and  not 
return  to  the  base  course  heading. 

Table  40.  Initial  Conditions  for  Atmospheric  Scenario  13.4 


Scenario 

13.4:  Maneuvering  flight  of  6-DOF  rigid  aircraft  with  non-linear  aerodynamics 
(subsonic):  Lateral  course  offset 

Vehicle 

F-16  with  simple  autopilot 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

60  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[36.01916667,  -75.67444444,  10013] 

[400,  400,  0] 

[0,  0,  45] 

[0,  0,  0] 

Notes 

Initially  straight  & level,  t = 20  sec:  2,000-ft  lateral  course  offset. 
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C.1.17  Check  -case  14  maneuvering  flight  of  a supersonic  aircraft. 

This  set  of  maneuvers  for  a supersonic  maneuvering  aircraft  was  intended  to  mimic  those  of  the  subsonic 
aircraft  described  in  check-cases  13.1  through  13.4  above.  Due  to  resource  constraints,  a working  autopilot 
was  not  completed  and  these  check-cases  were  not  performed. 

Table  41.  Initial  Conditions  for  Atmospheric  Scenario  14 


Scenario 

14:  Maneuvering  flight  of  6-DOF  rigid  aircraft  with  non-linear  aerodynamics 
(supersonic) 

Vehicle 

F-16  with  simple  autopilot 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

60  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[36.01916667,  -75.67444444,  30013] 

[1414.213562,  1414.213562,  0] 

[0,  0,  45] 

[0,  0,  0] 

Notes 

Initially  straight  & level,  t = 10  sec:  increment  throttle  0.5  (fraction)  for  5 sec. 
t = 20  sec:  long,  stick  doublet  amp  0.1  for  3 sec  each  way  (starting  aft),  t = 30  sec: 
rudder  pedal  doublet,  starting  right,  t = 40  sec:  roll  stick  doublet,  starting  right. 

C.1.18  Check-case  15  — circumnavigation  of  the  North  pole 

This  scenario  tested  for  state  propagation  difficulties  near  90°  latitude,  as  well  as  proper  wrapping  of  the 
vehicle  longitudinal  position  as  the  IDL  is  crossed  at  ±180  geodetic  longitude. 

For  this  scenario,  the  vehicle  started  at  an  initial  position  and  heading  near  the  north  pole  as  given  in 
Table  42.  The  F16-gnc  control  system  was  added  to  the  vehicle  to  provide  the  appropriate  steering  guidance 
(as  well  as  vehicle  control  and  augmented  stability).  The  selectCircumnavigator_disc  input  was  set  to  1.0  to 
indicate  the  north  pole  was  the  center  of  the  3-nm  circular  flight  path,  and  both  autopilotOn_discrete  and 
stabilityAugmentationOn_disc  were  set  to  1.0.  Both  geodetic  latitude  and  longitude  had  to  be  calculated  and 
provided  to  the  control  system  through  geLatitude  and  gn  Longitude  inputs,  respectively. 

The  vehicle  turned  left  from  the  original  heading,  flew  to  and  intercepted  the  desired  circular  track,  flying 
counter-clockwise  around  the  north  pole  for  the  duration  of  the  simulation. 
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Table  42.  Initial  Conditions  for  Atmospheric  Scenario  15 


Scenario 

15:  Circular  flight  around  North  Pole 

Vehicle 

F-16  with  circumnavigating  autopilot 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

180  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[89.95,  -45,  10000] 

[0,  563.643,  0] 

[0,  0,  90] 

[0,  0,  0] 

Notes 

Initial  conditions  trimmed  straight  and  level;  engage  autopilot  at  first  time  step. 

C.1.19  Check-case  16  — circular  flight  around  the  Equator-IDL  intersection 

This  scenario  tested  for  proper  change-of-sign  in  geodetic  latitude  as  the  Equator  was  crossed  in  both 
directions,  as  well  as  proper  wrapping  of  the  vehicle  longitudinal  position  as  the  IDL  was  crossed  in  both 
directions  at  ±180  geodetic  longitude. 

For  this  scenario,  the  vehicle  started  at  an  initial  position  and  heading  near  the  intersection  of  the  Equator 
and  IDL  as  given  in  Table  43.  The  F16.gnc  control  system  was  included  in  the  vehicle  model  to  provide 
the  appropriate  steering  guidance  (as  well  as  vehicle  control  and  augmented  stability).  The  selectCircum- 
navigator_disc  input  was  set  to  0 to  indicate  the  Equator-IDL  intersection  was  the  center  of  the  3 nm  circular 
flight  path,  and  both  autopilotOmdiscrete  and  stabilityAugmentationOmdisc  were  set  to  1.0.  Both  geodetic 
latitude  and  longitude  had  to  be  calculated  and  provided  to  the  control  system  through  geLatitude  and 
gnLongitude  inputs,  respectively. 

The  vehicle  turned  left  from  the  original  heading,  flew  to  and  intercepted  the  desired  circular  track,  flying 
counter-clockwise  around  the  0 latitude,  ±180°  longitude  location  for  the  duration  of  the  simulation. 

Table  43.  Initial  Conditions  for  Atmospheric  Scenario  16 


Scenario 

16:  Circular  flight  around  Equator/IDL  intersection 

Vehicle 

F-16  with  circumnavigating  autopilot 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

180  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[0,  -179.95,  10000] 

[563.643,  0,  0] 

[0,  0,  0] 

[0,  0,  0] 

Notes 

Initial  conditions  trimmed  straight  and  level;  engage  autopilot  at  first  time  step. 
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C.1.20  Check-case  17  — flight  of  two-stage  launch  vehicle 

The  final  “atmospheric”  check-case  employed  an  idealized  two-stage  rocket  that,  when  launched,  achieved 
a highly  elliptical  orbit  without  guidance.  Initial  conditions  are  given  in  Table  44;  the  vehicle  model  is 
described  in  Section  B.1.6. 

Due  to  the  lack  of  guidance  and  a strong  dependence  of  the  final  position  upon  very  small  attitude  changes 
and  timing  of  engine  burnout,  this  scenario  was  fairly  sensitive  to  integration  methods  and  simulation  step 
size.  It  was  recommended  to  use  a time  step  of  0.001  sec  (1,000  iterations  per  sec  of  simulation  time), 
especially  when  using  a lower-order  integration  method. 

This  case  also  required  some  external  logic  to  calculate  fuel  burn,  initiate  staging,  and  detect  burnout,  as 
described  in  Section  B.1.6. 

Table  44.  Initial  Conditions  for  Atmospheric  Scenario  17 


Scenario 

17:  Two-stage  rocket  to  orbit 

Vehicle 

Two-stage  unguided  rocket 

Geodesy 

WGS-84  rotating 

Atmosphere 

US  1976  STD;  no  wind 

Gravitation 

J2 

Duration 

200  s 

Initial  states 

Position 

(deg,  deg,  ft  MSL) 

Velocity 

ft/s 

Attitude 

deg 

Rate 

deg/s 

Geodetic 
Local-relative 
Body  axes 

[0,  0,  0] 

[0,  0,  -0.32808399] 

[0,  55.22,  90] 

[0,  0,  0] 

C.2  Orbital  scenarios 

The  goal  of  the  orbital  check-case  scenarios  was  to  compare  propagation  of  a 6-DOF  vehicle  in  an  orbital 
environment.  These  cases  idealized  the  vehicle  as  a rigid  body  and  compared  time  histories  of  position, 
velocity,  attitude  and  attitude  rate.  The  orbital  environment  is  fundamentally  different  from  the  atmospheric 
domain  because  orbiting  bodies  are  not  subject  to  the  strong  damping  effects  of  atmospheric  flight.  Therefore, 
even  tiny  perturbations  such  as  higher-order  gravitation  terms  and  third-body  effects  will  produce  large 
differences  in  vehicle  state  over  time. 

The  orbital  scenarios  (shown  in  Table  24)  were  designed  to  exercise  various  options  ranging  from  spherical 
Earth/gravitation  and  no  drag  to  full  geopotential-gravitation,  third-body  perturbations  and  drag.  The  tests 
were  organized  in  such  a way  as  to  build  incrementally  so  that  higher-order  effects  can  be  seen  as  they  are 
introduced.  These  scenarios  matched  those  developed  for  an  earlier  simulation  comparison  study.  [1] 

Tables  47  through  72  show  the  initial  conditions  for  each  of  the  atmospheric  check-cases. 

Key  parameters  that  are  commonly  needed  to  support  vehicle  state  propagation  were  also  compared.  For 
example,  in  order  to  compute  non-spherical  gravitational  accelerations,  they  must  be  calculated  in  the  ECEF 
frame.  These  accelerations  must  then  be  converted  into  a non-rotating  inertial  frame  (ECI)  for  integration. 

The  RNP  transformation  matrix  M,  representing  the  rotation,  nutation  and  precession  angles  between  the 
ECEF  and  ECI  frames,  is  required  to  convert  the  non-spherical  gravitational  accelerations  into  the  ECI 
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frame;  it  is  also  needed  in  order  to  relate  the  inertial  state  of  the  vehicle  to  locations  on  the  planet.  In 
the  same  manner,  we  needed  a model  of  the  upper  atmosphere  in  order  to  model  drag.  We  compared  RNP 
matrices  (inferred  from  ECEF  positions)  and  atmosphere  models  as  a means  of  isolating  sources  of  variation 
among  the  various  simulations. 

The  orbital  cases  can  be  described  according  to  the  following  outline: 

Drag-Free  Translation  These  were  primarily  designed  to  test  the  numerical  integration  and  gravitation 
models.  The  complexity  varied  from  pure  spherical  gravitation  through  higher-order  gravitational 
harmonics  and  third-body  effects. 

Translation  with  Drag  These  cases  were  similar  to  their  drag-free  counterparts  except  that  a simple  drag 
model  was  introduced  and  exercised  with  constant  and  variable  atmospheric  density.  In  all  orbital 
cases,  the  drag  was  modeled  by  a simple  ballistic  coefficient. 

Rotational  Propagation  These  cases  compared  the  rotational  propagation  with  various  initial  attitudes, 
attitude  rates,  and  torques. 

Maneuvers  These  cases  involved  application  of  thrust  to  change  the  trajectory  in  various  ways. 

Two  example  orbits  were  defined,  reusing  the  orbits  defined  the  draft  DSES  report  [25].  One  (given  in 
Table  45)  was  a nearly  circular  representative  of  a low  Earth  orbit;  the  other  (given  in  Table  46)  was  highly 
elliptical. 


Table  45.  Nearly  Circular  Example  Orbit  Definition  in  J2000  Coordinates 


Parameter 

Value 

Time 

2007/324:00:00:00  (UTC) 

rx 

-4,292,653.41  m 

rv 

955,168.47  m 

rz 

5,139,356.57  m 

vx 

109.649663  m/s 

Vy 

-7,527.726490  m/s 

vz 

1,484.521489  m/s 

The  specific  scenarios  for  each  of  the  orbital  check-cases  are  described  below,  along  with  a table  giving  both 
initial  state  values  and  problem  assumptions,  including  the  vehicle  being  simulated,  geodetic  Earth  model, 
atmosphere  model,  and  gravitational  model  to  be  used  as  well  as  test  duration. 

For  each  scenario,  the  duration  was  fixed  at  28,800  sec;  participants  were  encouraged  to  provide  data  recorded 
every  60  sec. 

C.2.1  Check-case  2 ISS  in  spherical  gravity 

This  was  the  simplest  orbital  check-case  in  which  all  effects  except  for  a pure  inverse-square  gravitation  field 
were  turned  off.  This  case  provided  an  opportunity  to  compare  integration  techniques  (by  comparing  inertial 
position  and  velocity)  and  models  for  Earth  rotation  (by  comparing  planet-fixed  position  and  velocity) . The 
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Table  46.  Highly  Elliptical  Example  Orbit  Definition  in  J2000  Coordinates 


Parameter 

Value 

Time 

2007/324:00:00:00  (UTC) 

rx 

-4,315,967.74  m 

rv 

960,356.20  m 

rz 

5,167,269.53  m 

Vx 

129.091037  m/s 

Vy 

-7,491.513855  m/s 

vz 

1,452.515654  m/s 

vehicle  was  an  idealization  of  the  International  Space  Station  described  in  Table  19,  and  the  orbit  is  described 
in  Table  45. 


Table  47.  Initial  Conditions  for  Orbital  Scenario  2 


Scenario 

2:  Keplerian  Propagation 

Vehicle  type 

ISS 

Orbit  type 

Nearly  circular 

Atmosphere  model 

Fi o,7  = 128.8  10-22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Off 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.2  Check-case  3A  ISS  in  4 x 4 harmonic  gravity 

This  check-case  was  identical  to  the  previous  check-case  (Check-case  2 - ISS  in  spherical  gravity)  except  that 
the  terms  of  degree  and  order  up  to  4 were  included  in  the  spherical  harmonics  gravitation  model.  This  case 
provided  a comparison  of  spherical  harmonics  gravitation  calculations  and  showed  the  effect  of  the  first  few 
non-spherical  terms  on  the  vehicle  state. 
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Table  48.  Initial  Conditions  for  Orbital  Scenario  3A 


Scenario 

3A:  4x4  Gravity  Model 

Vehicle  type 

ISS 

Orbit  type 

Nearly  circular 

Atmosphere  model 

Fio.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

Off 

Gravitation  model  order 

4x4 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Off 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.3  Check-case  3B  ISS  in  8 x 8 harmonic  gravity 

This  check-case  was  identical  to  “Check-case  2 - ISS  in  spherical  gravity”  except  that  the  terms  of  degree  and 
order  up  to  8 were  included  in  the  spherical  harmonics  gravitation  model.  This  case  provided  a comparison 
of  spherical  harmonics  gravitation  calculations  and  showed  the  effect  of  higher  order  non-spherical  terms  on 
the  vehicle  state. 
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Table  49.  Initial  Conditions  for  Orbital  Scenario  3B 


Scenario 

3B:  8x8  Gravity  Model 

Vehicle  type 

ISS 

Orbit  type 

Nearly  circular 

Atmosphere  model 

Ao.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

Off 

Gravitation  model  order 

8x8 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Off 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.4  Check-case  4 ISS  with  third-body  disturbances 

This  check-case  was  identical  to  “Check-case  2 - ISS  in  spherical  gravity”  except  that  the  gravitational 
effects  of  Sun  and  Moon  were  included.  This  case  required  an  ephemeris  model  (Jet  Propulsion  Laboratory’s 
DE405  [26])  was  used  and  demonstrated  the  effect  of  third-body  perturbations. 
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Table  50.  Initial  Conditions  for  Orbital  Scenario  4 


Scenario 

4:  Planetary  Ephemeris 

Vehicle  type 

ISS 

Orbit  type 

Nearly  circular 

Atmosphere  model 

A0.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

On 

Sun/Moon  perturbations 

On 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.5  Check-case  5A  ISS  (minimal  solar  activity) 

This  check-case  was  designed  to  exercise  the  MET  model  of  the  outer  atmosphere.  The  gravitation  model 
was  identical  to  that  in  the  “Check-case  2 - ISS  in  spherical  gravity”  scenario;  however,  the  initial  conditions 
placed  the  vehicle  in  the  highly  elliptical  orbit  (described  in  Table  46)  so  that  the  model  was  tested  over  a 
great  range  of  altitudes.  Although  the  atmospheric  model  was  included,  we  did  not  include  any  drag  forces 
for  this  case,  as  the  intent  was  to  compare  the  atmospheric  model  implementations  without  introducing 
other  factors.  These  cases  varied  the  input  parameter  F10 .7  described  in  Section  B.5.2  for  the  MET.  This 
case  used  a relatively  low  value  of  this  parameter. 
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Table  51.  Initial  Conditions  for  Orbital  Scenario  5A 


Scenario 

5A:  Minimum  Solar  Activity 

Vehicle  type 

ISS 

Orbit  type 

Highly  elliptical 

Atmosphere  model 

A0.7  = 70  10-22  watt  / m2  / Hz, 
Ap  = 0 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Sun  only 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.6  Check-case  5B  ISS  (mean  solar  activity) 

This  check-case  was  designed  to  exercise  the  MET  model  of  the  outer  atmosphere.  The  gravitation  model 
was  identical  to  that  in  the  “Check-case  2 - ISS  in  spherical  gravity”  scenario;  however,  the  initial  conditions 
placed  the  vehicle  in  the  highly  elliptical  orbit  (described  in  Table  46)  so  that  the  model  was  tested  over  a 
great  range  of  altitudes.  Although  the  atmospheric  model  was  included,  we  did  not  include  any  drag  forces 
for  this  case,  as  the  intent  was  to  compare  the  atmospheric  model  implementations  without  introducing 
other  factors.  These  cases  varied  the  input  parameter  F10  7 described  in  Section  B.5.2  for  the  MET.  This 
case  used  a nominal  value  of  this  parameter. 
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Table  52.  Initial  Conditions  for  Orbital  Scenario  5B 


Scenario 

5B:  Mean  Solar  Activity 

Vehicle  type 

ISS 

Orbit  type 

Highly  elliptical 

Atmosphere  model 

F10.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Sun  only 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.7  Check-case  5C  — ISS  (maximal  solar  activity) 

This  check-case  was  designed  to  exercise  the  MET  model  of  the  outer  atmosphere.  The  gravitation  model 
was  identical  to  that  in  the  “Check-case  2 - ISS  in  spherical  gravity”  scenario;  however,  the  initial  conditions 
placed  the  vehicle  in  the  highly  elliptical  orbit  (described  in  Table  46)  so  that  the  model  was  tested  over  a 
great  range  of  altitudes.  Although  the  atmospheric  model  was  included,  we  did  not  include  any  drag  forces 
for  this  case,  as  the  intent  is  to  compare  the  atmospheric  model  implementations  without  introducing  other 
factors.  These  cases  varied  the  input  parameter  Fw  ? described  in  Section  B.5.2  for  the  MET.  This  case 
used  a relatively  high  value  of  this  parameter. 
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Table  53.  Initial  Conditions  for  Orbital  Scenario  5C 


Scenario 

5C:  Maximum  Solar  Activity 

Vehicle  type 

ISS 

Orbit  type 

Highly  elliptical 

Atmosphere  model 

Flo. 7 = 250  1 0-  22  watt  / m2  / Hz, 
Ap  = 25 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Sun  only 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.8  Check-case  6A  sphere  with  fixed  drag 

This  was  the  first  check-case  involving  aerodynamic  drag.  In  order  to  isolate  the  effects  of  drag  from  the 
atmosphere  model,  the  density  was  fixed  at  a known,  constant  value.  The  vehicle  used  was  the  sphere 
described  in  Table  3,  and  drag  was  modeled  by  a simple  ballistic  coefficient.  The  initial  conditions  described 
in  Table  46  placed  the  vehicle  in  the  highly  elliptical  orbit  we  used  for  the  atmospheric  comparisons. 
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Table  54.  Initial  Conditions  for  Orbital  Scenario  6A 


Scenario 

6A:  Aerodynamic  Drag  with  Constant  Density 

Vehicle  type 

Sphere 

Orbit  type 

Highly  elliptical 

Atmosphere  model 

Fio.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

CD  = 0.02,  Siei  = 1 m2 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Sun  only 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.9  Check-case  6B  — sphere  with  dynamic  drag 

This  check-case  is  identical  to  the  previous  scenario  (Check-case  6A  - sphere  with  fixed  drag)  except  that 
the  constant  density  was  replaced  by  the  density  computed  by  the  MET  model. 
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Table  55.  Initial  Conditions  for  Orbital  Scenario  6B 


Scenario 

6B:  Aerodynamic  Drag  with  Dynamic  Atmosphere 

Vehicle  type 

Sphere 

Orbit  type 

Highly  elliptical 

Atmosphere  model 

F\ o.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

CD  = 0.02,  Siei  = 1 m2 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Sun  only 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.10  Check-case  6C  — cylinder  undergoing  plane  change  firing 

This  check-case  had  the  same  gravitation,  initial  conditions  and  drag  configuration  as  the  “Check-case  2 
- ISS  in  spherical  gravity”  scenario,  except  that  the  mass  properties  were  those  of  the  1,000-kg  cylinder 
described  in  Table  6,  and  the  initial  attitude  was  aligned  with  the  LVLH  frame. 

After  1,000  sec,  a force  of  29,000  N was  applied  along  the  — y body  axis  (through  the  vehicle’s  CM).  Due 
to  the  initial  orientation  and  the  fact  that  the  vehicle  maintained  a fixed  LVLH  orientation,  this  thrust  was 
directed  perpendicular  to  the  plane  of  the  orbit.  The  duration  of  the  maneuver  was  93  sec. 
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Table  56.  Initial  Conditions  for  Orbital  Scenario  6C 


Scenario 

6C:  Plane  Change  Maneuver 

Vehicle  type 

Cylinder 

Orbit  type 

Nearly  circular 

Atmosphere  model 

Fio.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Sun  only 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,0.000000,0.000000]  deg 

Notes 

29,  000  N force  in  negative  body  y- axis  direction, 
starting  at  t = 1, 000  sec  for  93  sec 

C.2.11  Check  -case  6D  cylinder  undergoing  Earth  departure  firing 

This  check-case  was  identical  to  the  “Check-case  6C  - cylinder  undergoing  plane  change  firing”  scenario 
except  that  a force  of  66, 400  N was  applied  along  the  +x  body  axis  direction  (through  the  vehicle’s  CM)  for 
48  sec.  Due  to  the  direction  and  magnitude  of  the  force,  the  effect  was  performance  of  an  Earth  departure 
maneuver. 
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Table  57.  Initial  Conditions  for  Orbital  Scenario  6D 


Scenario 

6D:  Earth  Departure  Maneuver 

Vehicle  type 

Cylinder 

Orbit  type 

Nearly  circular 

Atmosphere  model 

Ao.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Sun  only 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,0.000000,0.000000]  deg 

Notes 

66, 400  N force  in  positive  body  x-axis  direction, 
starting  at  t = 1, 000  sec  for  48  sec 

C.2.12  Check-case  7A  — sphere  in  4 x 4 gravity  and  third-body  perturbations 

This  check-case  showed  the  effects  of  low-order  spherical  harmonics  along  with  third-body  perturbations.  It 
was  similar  to  “Check-case  3A  ISS  in  4 x 4 harmonic  gravity”  scenario  with  the  following  exceptions: 

• The  mass  properties  of  the  vehicle  were  those  of  the  sphere  described  by  Table  3 rather  than  those  of 
the  ISS. 

• The  orbit  was  highly  elliptical  which  tended  to  demonstrate  third-body  effects. 

• Gravitation  from  Sun  and  Moon  were  both  included. 
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Table  58.  Initial  Conditions  for  Orbital  Scenario  7 A 


Scenario 

7A:  No  Drag  with  4x4  Gravity 

Vehicle  type 

Sphere 

Orbit  type 

Highly  Elliptical 

Atmosphere  model 

Fio.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

Off 

Gravitation  model  order 

4x4 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

On 

Sun/Moon  perturbations 

On 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.13  Check-case  7B  sphere  in  8 x 8 gravity  and  third-body  perturbations 

This  check-case  was  identical  to  the  previous  scenario  (Check-case  7A  - sphere  in  4 x 4 gravity  and  third-body 
perturbations)  except  that  the  degree  and  order  of  the  Earth  gravitation  field  was  8x8  rather  than  4x4. 
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Table  59.  Initial  Conditions  for  Orbital  Scenario  7B 


Scenario 

7B:  No  Drag  with  8x8  Gravity 

Vehicle  type 

Sphere 

Orbit  type 

Highly  elliptical 

Atmosphere  model 

Fio.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

Off 

Gravitation  model  order 

8x8 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

On 

Sun/Moon  perturbations 

On 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.14  Check-case  7C  — sphere  in  4 x 4 gravity  with  drag  and  third-body  perturbations 

This  check-case  was  identical  to  the  “Check-case  7A  - sphere  in  4 x 4 gravity  and  third-body  perturbations” 
scenario  except  that  aerodynamic  drag  was  enabled  as  in  the  “Check-case  6B  - sphere  with  dynamic  drag” 
scenario. 
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Table  60.  Initial  Conditions  for  Orbital  Scenario  7C 


Scenario 

7C:  All  Models  with  4x4  Gravity 

Vehicle  type 

Sphere 

Orbit  type 

Highly  elliptical 

Atmosphere  model 

Ao.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

CD  = 0.02,  Siei  = 1 m2 

Gravitation  model  order 

4x4 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

On 

Sun/Moon  perturbations 

On 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.15  Check-case  7D  — sphere  in  8 x 8 gravity  with  drag  and  third-body  perturbations 

This  case  was  identical  to  “Check-case  7C  - sphere  in  4 x 4 gravity  with  drag  and  third-body  perturbations” 
scenario  except  that  the  degree  and  order  of  the  Earth  gravitation  field  was  8x8  rather  than  4x4. 
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Table  61.  Initial  Conditions  for  Orbital  Scenario  7D 


Scenario 

7D:  All  Models  with  8x8  Gravity 

Vehicle  type 

Sphere 

Orbit  type 

Highly  elliptical 

Atmosphere  model 

Ao.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

CD  = 0.02,  Siei  = 1 m2 

Gravitation  model  order 

8x8 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

On 

Sun/Moon  perturbations 

On 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.16  Check-case  8A  ISS  free  rotation  with  zero  rates 

This  was  the  first  check-case  which  compared  rotational  propagation.  The  configuration  for  gravitation, 
drag,  mass  properties  and  orbit  were  the  same  as  original  “Check-case  2 - ISS  in  spherical  gravity”  scenario. 
The  difference  was  that  the  orientation  and  attitude  rates  were  set  with  respect  to  the  inertial  as  opposed 
to  the  local  LVLH  frame.  The  attitude  rates  were  set  to  0 with  respect  to  the  inertial  frame. 

Table  62.  Initial  Conditions  for  Orbital  Scenario  8 A 


Scenario 

8A:  Zero  Initial  Attitude  Rate 

Vehicle  type 

ISS 

Orbit  type 

Nearly  circular 

Atmosphere  model 

Off 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Off 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000, 0.000000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 
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C.2.17  Check  -case  8B  — ISS  free  rotation  with  a non-zero  rates 

The  configuration  of  this  check-case  was  identical  to  that  for  “Check-case  2 - ISS  in  spherical  gravity.”  It 
was  repeated  here  to  highlight  the  effect  of  a non-zero  inertial  attitude  rate. 

Table  63.  Initial  Conditions  for  Orbital  Scenario  8B 


Scenario 

8B:  Non-zero  Initial  Attitude  Rate 

Vehicle  type 

ISS 

Orbit  type 

Nearly  circular 

Atmosphere  model 

Off 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Off 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.18  Check-case  9A  — ISS  being  torqued  with  zero  initial  rates 

This  check-case  was  identical  to  “Check-case  8A  - ISS  free  rotation  with  zero  rates”  except  that  beginning  at 
t = 1, 000  sec,  a torque  of  10  N-m  was  applied  about  the  positive  body  x-axis.  The  applied  torque  continued 
for  an  additional  1,  000  sec,  then  was  set  to  zero  for  the  duration  of  the  run. 

Table  64.  Initial  Conditions  for  Orbital  Scenario  9A 


Scenario 

9A:  Zero  Initial  Attitude  Rate  with  Torque 

Vehicle  type 

ISS 

Orbit  type 

Nearly  circular 

Atmosphere  model 

Off 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Off 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000, 0.000000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 
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C.2.19  Check-case  9B  — ISS  being  torqued  with  non-zero  initial  rates 

This  check-case  was  identical  to  C.2.17  except  that  beginning  at  t = 1,000  sec,  a torque  of  10  N-m  was 
applied  about  the  positive  body  x-axis.  The  applied  torque  continued  for  an  additional  1,000  sec,  then  was 
set  to  zero  for  the  duration  of  the  run. 

Table  65.  Initial  Conditions  for  Orbital  Scenario  9B 


Scenario 

9B:  Non-zero  Initial  Attitude  Rate  with  Torque 

Vehicle  type 

ISS 

Orbit  type 

Nearly  circular 

Atmosphere  model 

Off 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Off 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.20  Check-case  9C  — ISS  under  torque  and  force  with  zero  initial  rates 

This  check-case  was  identical  to  “Check-case  8A  - ISS  free  rotation  with  zero  rates”  except  that  beginning 
at  t = 1,  000  sec,  a force  of  10  N was  applied  in  the  positive  body  x-axis  direction,  through  the  vehicle’s  CM, 
and  a torque  of  10  N-m  was  applied  about  the  positive  body  x-axis.  The  external  force  and  torque  were 
applied  for  an  additional  1,000  sec,  then  were  set  to  zero  for  the  duration  of  the  run. 
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Table  66.  Initial  Conditions  for  Orbital  Scenario  9C 


Scenario 

9C:  Zero  Initial  Attitude  Rate  with  Torque  and 
Force 

Vehicle  type 

ISS 

Orbit  type 

Nearly  circular 

Atmosphere  model 

Off 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Off 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000, 0.000000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.2.21  Check-case  9D  — ISS  under  torque  and  force  with  a non-zero  initial  rates 

This  check-case  was  identical  to  “Check-case  8B  - ISS  free  rotation  with  a non-zero  rates”  except  that 
beginning  at  t = 1,000  sec,  a force  of  10  N was  applied  in  the  positive  body  x-axis  direction,  through  the 
vehicle’s  CM,  and  a torque  of  10  N-m  was  applied  about  the  positive  body  x-axis.  The  external  force  and 
torque  were  applied  for  an  additional  1,000  sec,  then  were  set  to  zero  for  the  duration  of  the  run. 

Table  67.  Initial  Conditions  for  Orbital  Scenario  9D 


Scenario 

9D:  Non-zero  Initial  Attitude  Rate  with  Torque 
and  Force 

Vehicle  type 

ISS 

Orbit  type 

Nearly  circular 

Atmosphere  model 

Off 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

Off 

Planetary  ephemeris 

Off 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 
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C.2.22  Check-case  10A  cylinder  in  circular  orbit  with  gravity  gradient  with  zero  initial 
rates 

This  was  the  first  of  the  check-cases  for  the  effects  of  gravity  gradient  torque.  These  cases  all  used  the  same 
cylindrical  body  described  by  Table  6.  The  initial  attitude  was  defined  with  respect  to  the  LVLH  frame  in 
such  a way  that  the  cylinder  was  pitched  at  an  angle  of  85  degrees  from  the  local  horizontal,  and  then  yawed 
1 degree  out  of  the  LVLH  X-Z  plane.  For  this  case,  we  used  the  nearly  circular  orbit  with  initial  conditions 
described  in  Table  45.  This  gave  rise  to  a system  that,  in  the  limit  of  small  angle  approximations,  acted  like 
a simple  harmonic  oscillator  with  the  pitch  angle  rocking  through  a 10-degree  range  about  the  local  vertical 
and  the  yaw  oscillating  through  a 2-degree  range  of  the  LVLH  X-Z  plane. 

Table  68.  Initial  Conditions  for  Orbital  Scenario  10A 


Scenario 

10A:  Zero  Initial  Rotation  Rate  in  Circular  Orbit 
with  Gravity  Gradient 

Vehicle  type 

Cylinder 

Orbit  type 

Nearly  circular 

Atmosphere  model 

Flo. 7 = 128.8  10~22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

On 

Planetary  ephemeris 

Off 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000, 0.000000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,85.000000, 1.000000]  deg 

C.2.23  Check-case  10B  — cylinder  in  circular  orbit  with  gravity  gradient  with  non-zero  initial 
rates 

This  case  differed  from  “Check-case  10A  - cylinder  in  circular  orbit  with  gravity  gradient  with  zero  initial 
rates”  only  in  that  there  was  a small  initial  pitch  rate  of  0.01  deg/s.  The  effect  was  to  slightly  increase  the 
amplitude  and  retard  the  phase  of  the  pitch  oscillation. 
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Table  69.  Initial  Conditions  for  Orbital  Scenario  10B 


Scenario 

10B:  Non-zero  Initial  Rotation  Rate  in  Circular 
Orbit  with  Gravity  Gradient 

Vehicle  type 

Cylinder 

Orbit  type 

Nearly  circular 

Atmosphere  model 

.Fio.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

On 

Planetary  ephemeris 

Off 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,85.000000, 1.000000]  deg 

C.2.24  Check-case  IOC  — cylinder  in  elliptical  orbit  with  gravity  gradient  with  zero  initial 
rates 

This  check-case  differed  from  “Check-case  10A  - cylinder  in  circular  orbit  with  gravity  gradient  with  zero 
initial  rates”  only  in  that  we  used  the  highly  elliptical  orbit  described  in  Table  46.  This  demonstrated  that 
the  frequency  of  the  resulting  oscillations  was  a function  of  the  magnitude  of  the  gravity  gradient,  which  is 
a function  of  the  altitude.  The  vehicle  rocked  more  slowly  at  apoapsis,  and  more  rapidly  near  periapsis. 
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Table  70.  Initial  Conditions  for  Orbital  Scenario  10C 


Scenario 

10C:  Zero  Initial  Rotation  Rate  in  Elliptical  Orbit 
with  Gravity  Gradient 

Vehicle  type 

Cylinder 

Orbit  type 

Highly  elliptical 

Atmosphere  model 

Fio.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

On 

Planetary  ephemeris 

Off 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000, 0.000000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,85.000000, 1.000000]  deg 

C.2.25  Check-case  10D  — cylinder  in  elliptical  orbit  with  gravity  gradient  with  a non-zero 
initial  rates 

This  check-case  differed  from  check-case  10C  only  in  that  there  was  a tiny  initial  pitch  rate.  The  effect  was 
to  slightly  increase  the  amplitude  and  retard  the  phase  of  the  pitch  oscillation. 
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Table  71.  Initial  Conditions  for  Orbital  Scenario  10D 


Scenario 

10D:  Non-zero  Initial  Rotation  Rate  in  Elliptical 
Orbit  with  Gravity  Gradient 

Vehicle  type 

Cylinder 

Orbit  type 

Highly  elliptical 

Atmosphere  model 

F\ o.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

Off 

Gravitation  model  order 

Inverse  square 

Gravity  gradient  effects 

On 

Planetary  ephemeris 

Off 

Sun/Moon  perturbations 

Off 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,85.000000, 1.000000]  deg 

C.2.26  Check-case  Full  — ISS  responding  to  all  effects 

This  was  the  culminating  orbital  check-case  where  we  turned  on  all  effects  common  to  the  available  simula- 
tions. These  were: 

• 8 x 8 gravitation  model 

• Gravity  gradient  (spherical  term  only,  with  no  gradient  contribution  from  Sun  or  Moon).) 

• Third-body  effects  from  Sun  and  Moon  (spherical  model  only). 

• Constant  aerodynamic  drag  as  check-case  6B. 

• Highly  elliptical  orbit  described  in  Table  46 
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Table  72.  Initial  Conditions  for  Orbital  Scenario  Full 


Scenario 

Full:  All  Effects  in  Elliptical  Orbit 

Vehicle  type 

ISS 

Orbit  type 

Highly  elliptical 

Atmosphere  model 

Ao.7  = 128.8  1 0 - 22  watt  / m2  / Hz, 
Ap  = 15.7 

Aerodynamic  drag 

CD  = 2,  Sref=  1,400  m2 

Gravitation  model  order 

8x8 

Gravity  gradient  effects 

On 

Planetary  ephemeris 

On 

Sun/Moon  perturbations 

On 

Initial  inertial  rotation  rate 
(body  axes) 

[0.000000,  -0.065000, 0.000000]  deg/s 

Initial  LVLH  attitude  (3-2-1 
Euler  sequence) 

[0.000000,  -11.600000, 0.000000]  deg 

C.3  Geodetic  parameters  used  for  comparisons 

For  historical  reasons,  the  exact  WGS-84  [7]  geodetic  and  gravitational  parameters  were  not  used  for  the 
orbital  check-cases.  Instead,  the  parameters  used  in  the  original  DSES  study  [25]  were  re-used.  These 
parameters  were  cited  to  have  come  from  the  “Explanatory  Supplement  to  the  Astronomical  Almanac”  [27] 
which  itself  included  the  Goddard  Earth  Model  T1  (GEM-T1)  [28]  geodesy  model.  However,  in  the  DSES 
study,  some  of  these  parameters  were  truncated. 

Table  73  contains  parameter  values  and  unit  conversions,  in  SI  and  English  units,  that  should  be  used  in 
attempting  to  replicating  the  check-case  results  given  in  Section  D.  Table  74  contains  the  coefficients  for  the 
spherical  harmonic  geopotential  model  to  be  used  for  orbital  check-cases  that  specify  4 x 4 or  8 x 8 harmonics; 
these  were  based  on  GEM-T1  [28]. 


D Results 

One  purpose  of  the  check-cases  is  to  assess  the  extent  to  which  differences  in  implementation  (such  as 
selection  of  native  coordinate  systems)  can  affect  results.  Despite  an  attempt  to  define  initial  conditions 
(attitudes,  positions,  rates  and  velocities)  as  unambiguously  as  possible,  some  ambiguity  remained  (and 
the  initial  condition  values  continued  to  be  refined  throughout  the  assessment)  which  illustrated  one  of  the 
challenges  in  communicating  simulation  models  between  different  simulation  frameworks. 

In  general,  the  atmospheric  results  are  given  in  English  units.  This  is  believed  to  be  common  practice  in  the 
U.S.  even  as  the  orbital  community  has  mostly  adopted  SI  units;  this  paper  reflects  that  difference  between 
the  U.S.  aviation  and  space  communities.  (There  are  exceptions  in  both  camps;  several  of  these  tools  can 
handle  either  set  of  units.) 

The  identities  of  the  various  tools  were  masked  to  encourage  participation  in  this  voluntary  effort.  Also, 
the  atmospheric  cases  used  numerical  designations  (SIM  1,  SIM  2,  etc.)  while  the  orbital  cases  used  alpha 
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Table  73.  Geodetic  Model  Parameters  and  Unit  Conversions  for  Ellipsoidal  Earth 


Atmospheric  check-cases 

Parameter  SI  units 

English  units 

Equatorial  radius  of  the  Earth 
Radius  of  the  sphere  Earth  model 
Gravitational  constant  for  the  Earth 
Rotation  Rate  of  the  Earth 
Second  degree  zonal  harmonic  ( J2) 
Flattening  of  the  WGS84  Earth  (1//) 

6378137.0  m 
6371007.1809  m 
3.986004418  x 1014  m3/s2 

20925646.32546  ft 
20902254.5305  ft 
1.407644175720511  x 1016  ft3/s2 
7.292115  x 10"5  rad/s 
0.00108262982 
298.257223563 

Parameter 

Orbital  check-cases 

SI  units 

English  units 

Equatorial  radius  of  the  Earth 
Gravitational  constant  for  the  Earth 
Gravitational  constant  for  the  Sun 
Gravitational  constant  for  the  Moon 
Rotation  Rate  of  the  Earth 
Flattening  of  the  Earth  (1//) 

IERS  Leap  Seconds 
DUT1  Time  Correction 

6378137.0  m 
3.98600436  x 1014  m3/s2 
1.3271244  x 102°  m3/s2 
4.90266  x 1012  m3/s2 

20925646.32546  ft 
1.407644155238004  x 1016  ft3/s2 
4.686695588395551  x 1021  ft3/s2 
1.731358039487733  x 1014  ft3/s2 
7.29211514670638  x 10"5  rad/s 

298.3 
32  s 
—0.469  s 

Units  from/to 

Unit  Conversions 

Exact 

Approximate  value 

meter  to  foot 
ft/s  to  knot  conversion 
m/s  to  knot  conversion 
kilogram  to  slug 
radians  to  degrees 

1/0.3048 

1097.28/1852 

3600/1852 

0.3048/4.4482216152605 

180/tt 

3.28083989501312336 

0.59248380129589633 

1.94384449244060475 

0.0685217658567917552 

57.2957795130823209 
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Table  74.  Geopotential  Harmonic  Coefficients  for  Ellipsoidal  Earth 


Coefficient 

Value 

Coefficient 

Value 

C2,0 

-4.8416499  x 10”4 

52,o 

0 

C 2,1 

0 

'S'2,1 

0 

C2,2 

2.4389280  x 10”6 

S2,2 

-1.3998397  x 10"6 

C3,0 

9.5723751  x 10“7 

$3,0 

0 

C3.1 

2.0297737  x 10”6 

S3, 1 

2.4959463  x 10"7 

^3,2 

9.0354910  x 10~7 

S3, 2 

-6.2041982  x 10"7 

£3,3 

7.2098662  x 10”7 

S3, 3 

1.4131694  x 10"6 

C4,o 

5.3873219  x 10”7 

S4, 0 

0 

Ci,  1 

-5.3342722  x 10”7 

Si,  1 

-4.7511891  x 10"7 

C4, 2 

3.4700208  x 10~7 

Si,  2 

6.6403042  x 10"7 

C4,3 

9.9097790  x 10”7 

S4,3 

-2.0062149  x 10"7 

C4,4 

-1.9003480  x 10~7 

S4,4 

3.0845955  x 10"7 

c.5,0 

6.8780161  x 10“8 

S5, 0 

0 

Cs.i 

-5.8950310  x 10”8 

S5.1 

-9.5543463  x 10"8 

C5.2 

6.5579025  x 10"7 

S5,2 

-3.2340559  x 10"7 

C5,3 

-4.4820358  x 10~7 

S5,3 

-2.1513633  x 10"7 

C5,4 

-2.9482361  x 10”7 

S3, 4 

5.2408737  x 10"8 

C5.5 

1.7775628  x 10"7 

S5,5 

-6.6602811  x 10"7 

C6,0 

-1.4810038  x 10”7 

S&,  O 

0 

C6,l 

-8.1375094  x 10~8 

*5^6,1 

2.3890050  x 10"8 

CG,2 

5.1609578  x 10~8 

S6,2 

-3.7499560  x 10"7 

Ce,3 

6.1970909  x lO'8 

S6,3 

4.6429830  x 10"9 

c6A 

-9.2797469  x 10”8 

S6,4 

-4.7330695  x 10"7 

CeA 

-2.6576497  x 10"7 

S6,5 

-5.3774724  x 10"7 

Ce,6 

9.0593110  x 10”9 

Se,6 

-2.3633442  x 10"7 

Ci,o 

9.0533705  x 10"8 

S7, 0 

0 

Ct,i 

2.7709714  x 10”7 

S7.I 

9.7817738  x 10"8 

C7.2 

3.1771079  x 10"7 

St, 2 

9.1608267  x 10"8 

CV,3 

2.5074289  x 10”7 

St, 3 

-2.0916391  x 10"7 

CVj4 

-2.7374044  x 10”7 

St, 4 

-1.2202073  x 10"7 

CV,5 

3.4749784  x 10”9 

St, 5 

1.9651896  x 10"8 

C7,6 

-3.5785266  x 10”7 

St, 6 

1.5091751  x 10"7 

CV,7 

1.5976040  x 10”9 

S7, 7 

2.2001281  x 10"8 

Cs.O 

4.5902321  x 10”8 

S8,o 

0 

C8,l 

2.8856051  x 10”8 

S8,i 

5.4722278  x 10"8 

Cs,2 

7.0380074  x 10”8 

S8,2 

6.8449357  x 10"8 

C8,3 

-1.9966400  x 10”8 

S8,3 

-8.6936688  x 10"8 

C8,4 

-2.4606388  x 10”7 

S8,4 

6.7745274  x 10"8 

C8,5 

-2.4933453  x 10~8 

S8,5 

8.5300324  x 10"8 

C8,6 

-6.6417800  x 10”8 

S8,6 

3.1283228  x 10"7 

C8,7 

7.0424829  x 10~8 

S8,7 

7.4862572  x 10"8 

C8,8 

-1.1888272  x 10”7 

S8,8 

1.2233200  x 10"7 
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designations  (SIM  A,  SIM  B,  etc.)  to  identify  the  various  simulations.  Two  of  these  simulation  tools  are 
represented  in  both  atmospheric  and  orbital  results. 

Simulation  developers  were  free  to  pick  the  numerical  integration  time  step  sizes  and  integration  methods 
that  they  felt  gave  the  most  accurate  results.  There  was  no  requirement  to  run  in  real-time  (e.g.,  pilot-  or 
hardware- in-the-loop) . 

In  plotting  differences  from  average,  a difficulty  was  encountered  with  angles  restricted  to  fall  within  a range 
of  values.  For  example,  vehicle  yaw  angle  ip  is  kept  within  —180  < 9 < +180  degrees.  When  calculating  a 
difference  or  an  average  on  these  values,  as  soon  as  one  simulation  tool  performs  the  wrap  limit,  the  numerical 
difference  or  average  of  the  ensemble  makes  no  sense.  For  this  reason,  the  Euler  angles  and  angles  of  latitude 
and  longitude  are  not  differenced  against  some  average.  Instead,  the  angle  difference  between  two  angles  a 
and  /3  is  calculated  using  the  trigonometric  angle  difference  equation  37: 


„ sin  a cos  /3  — cos  a sin  /3 

a — p = arctan ; ; — - 

cos  a cos  p + sm  a sin  p 


(37) 


In  this  report,  the  angles  estimated  by  SIM  5 and  SIM  B are  used  as  the  somewhat  arbitrary  reference,  since 
they  are  present  in  most  check-cases  and  appear  reasonable. 

Table  75  provides  a description  of  the  output  quantities  that  are  compared  in  the  ensuing  trajectory  plots. 
These  variable  names  are  based  on  the  S-119  standard  and  often  include  units-of- measure  as  a suffix. 
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D.l  Scenario  comparisons  — Atmospheric 

D.l.l  Check-case  1 dragless  sphere 

This  section  shows  cross-plots  for  six  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a dragless 
spheroid,  accelerating  towards  the  surface  of  the  Earth  from  30,000  ft  above  the  Equator.  This  scenario  is 
described  in  Section  C.1.1.  Figures  16a  through  16x  compare  results  between  the  six  simulation  tools,  as 
well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

In  this  check-case  the  atmospheric  forces  and  moments  acting  on  the  vehicle  were  zero.  The  inertial  rotational 
rate  expressed  in  body  coordinates  (p,  q,  r)  was  also  zero.  Thus,  the  apparent  rotation  of  the  sphere  with 
respect  to  the  Earth  was  due  to  the  Earth’s  rotation  and,  given  the  initial  north-up  orientation  of  the  sphere, 
caused  only  the  roll  angle  to  change.  All  the  simulations  accurately  produced  these  outcomes. 

The  translational  motion  of  the  sphere  was  governed  only  by  gravitation  and  the  centrifugal  and  Coriolis 
accelerations  due  to  the  Earth’s  rotation.  The  net  effect  of  the  stronger  gravitation  acting  against  the 
weaker  centrifugal  accelerations  caused  the  sphere  to  descend  and  the  Coriolis  acceleration  caused  the  sphere 
to  travel  slightly  eastward.  In  general,  the  simulations  agreed  in  the  translational  motion  of  the  sphere.  The 
differences  shown  were  less  than  0.01  inches  in  position  and  0.01  in/s  in  velocity.  The  differences  shown  were 
assumed  to  reflect  differences  in  numerical  integration  techniques  used  by  the  different  simulation  tools. 

For  atmospheric  properties,  there  was  close  agreement  among  the  simulations  for  temperature.  However,  for 
atmospheric  density  and  pressure,  only  SIM  3,  4,  5,  and  6 came  to  consensus.  The  difference  between  SIM  1, 
SIM  2,  and  the  consensus  group  was  the  result  of  different  approaches  to  implementing  the  U.S.  Standard 
Atmosphere  1976  Model.  The  consensus  group  solved  the  actual  mathematical  equations  for  temperature, 
pressure,  and  density.  On  the  other  hand,  SIM  1 and  SIM  2 used  lookup  tables  with  linear  interpolation 
between  breakpoints.  SIM  1 used  a table  with  1,000-meter  breakpoints;  SIM  2 used  a table  with  500- 
meter  breakpoints.  Because  the  temperature  formula  is  a linear  function,  linear  interpolation  produced  no 
temperature  differences  between  SIM  1,  SIM  2,  and  the  consensus  group.  However,  pressure  and  density 
are  not  linear  functions;  therefore,  the  difference  in  density  and  pressure  between  SIM  1,  SIM  2,  and  the 
consensus  group  depicted  a hill-and-valley  pattern,  in  which  each  valley  of  near-zero  difference  was  associated 
with  a break-point  in  the  lookup  table.  The  hill  pattern  difference  in  density  also  caused  the  hill-and-valley 
pattern  difference  seen  for  SIM  1 in  dynamic  pressure. 
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D.1.2  Check-case  2 — dragless  tumbling  brick 

This  section  shows  cross-plots  for  five  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a dragless 
tumbling  brick  with  no  damping  accelerating  towards  the  surface  of  the  Earth  from  30,000  ft  above  the 
Equator  and  with  an  initial  inertial  angular  rate  (10,  20  and  30  deg/s,  respectively,  in  the  body  axis  system). 
This  scenario  is  described  in  Section  C.1.2.  Figures  17a  through  17x  compare  results  between  the  five 
simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

Although  the  simulated  vehicle  changed  from  a sphere  to  a brick,  gravitation  remains  the  only  external 
force  acting  on  the  vehicle  in  this  check-case.  Therefore,  the  translational  motion  in  this  scenario  was 
identical  to  the  previous  one  (Check-case  1 dragless  sphere).  As  with  check-case  1,  all  simulations  agreed 
on  translational  states  to  better  than  0.01  inches  in  position  and  0.01  in/s  in  velocity.  Likewise,  the  results 
for  atmospheric  properties,  which  were  functions  of  position,  are  identical  to  those  in  case  1.  The  differences 
presented  were  due  to  the  difference  between  algebraic  and  linear  table  interpolation  implementations  of  the 
atmosphere  model. 

Rotational  dynamics  were  the  focus  of  this  check-case.  This  scenario  simulated  a brick  with  a constant 
angular  momentum.  The  resulting  inertial  angular  rates  expressed  in  body  coordinates  (i.e. , p,  q , and  r) 
were  sinusoids  with  a constant  amplitude  and  frequency.  The  simulations  generally  agreed  on  the  angular 
rates  to  within  0.004  deg/s.  These  differences  are  assumed  to  reflect  differences  in  the  numerical  integration 
methods  between  the  simulations  when  integrating  angular  accelerations  into  angular  rates.  For  orientation, 
all  simulations  except  SIM  2 were  in  close  agreement.  The  Euler  angle  solution  from  SIM  2 slowly  diverged 
from  the  other  simulations  over  time  with  differences  approaching  ±4  degrees  after  t = 30  sec.  This  difference 
appears  to  result  from  the  difference  in  the  integration  method  of  SIM  2 for  the  integral  that  integrated 
orientation  from  the  angular  rates. 
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D.1.3  Check-case  3 — dragless  tumbling  brick  with  aerodynamic  damping 

This  section  shows  cross-plots  for  five  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a dragless 
tumbling  brick  with  aerodynamic  damping,  accelerating  as  it  falls  through  the  atmosphere,  after  starting 
with  an  initial  inertial  angular  rate  (10,  20  and  30  deg/s,  respectively,  in  the  body  axis  system).  This  scenario 
is  described  in  Section  C.1.3.  Figures  18a  through  18x  compare  results  between  the  five  simulation  tools,  as 
well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

Results  for  translational  states  and  atmospheric  properties  were  identical  to  the  two  previous  check-cases. 
This  check-case  expanded  upon  the  previous  scenario  (Check-case  2 - dragless  tumbling  brick)  by  adding 
aerodynamic  damping  to  the  rotational  motion  of  the  brick.  Due  to  the  differences  in  atmospheric  density, 
the  aerodynamic  moments  for  SIM  1 and  SIM  2 differed  slightly  (less  than  ±3.5  x 10~6  lbf-ft)  from  the 
remaining  simulations.  In  turn,  the  combination  of  aerodynamic  differences  and  differences  in  integration 
methods  produced  differences  in  inertial  angular  rates  smaller  than  ±0.06  deg/s.  However,  the  largest 
differences  were  confined  to  the  first  20  sec  before  the  aerodynamic  damping  reduced  the  angular  momentum 
of  the  brick  to  near  zero.  These  differences  in  angular  rates  combined  with  additional  differences  in  integration 
error  from  the  integration  of  the  angular  rates  to  produce  differences  in  the  predicted  orientation  of  the  brick 
between  the  simulations. 

In  yaw  angle,  SIM  4,  5,  and  6 agreed  on  orientation  to  within  0.05  degrees.  SIM  2 settled  to  a difference,  from 
the  ensemble  average,  of  about  —0.15  degrees  from  a peak  difference  of  —0.35  degrees  at  around  t = 9 sec. 
SIM  1 had  an  increasing  difference  that  settled  to  around  —0.32  degrees.  In  pitch  angle,  SIM  1,  4,  5,  and  6 
agree  to  within  about  0.1  degree.  After  about  six  seconds,  SIM  2 exhibited  an  increasing  difference  with  the 
other  simulations  that  decreased  to  less  than  —0.65  degrees  at  the  end  of  the  run.  In  roll  angle,  all  simulations 
agreed  to  within  0.1  degrees  by  the  end  of  the  run  although  SIM  2 did  exhibit  an  earlier  departure  from  the 
other  simulations  that  peaked  near  0.5  degrees  at  around  t = 7.5  sec. 
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D.1.4  Check-case  4 — sphere  dropping  over  non-rotating,  spherical  Earth 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a sphere 
dropped  with  a fixed  drag  coefficient  through  a still  atmosphere  in  a non-rotating  Earth  with  spherical 
gravity.  This  scenario  is  described  in  Section  C.1.4.  Figures  19a  through  19x  compare  results  between  the 
four  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average 
value. 

This  check-case  exercised  both  translational  and  rotational  motion  over  a non-rotating,  spherical  Earth.  In 
general  SIM  4,  5,  and  6 agreed  on  the  predicted  translational  states  of  the  sphere.  There  are  a number  of 
factors,  however,  that  caused  SIM  2 to  produce  a different  trajectory.  First,  SIM  2 showed  an  initial  north 
velocity  of  0.01  ft/s  while  the  other  simulations  have  an  initial  north  velocity  of  zero.  The  difference  in  initial 
north  velocity  led  to  a difference  in  latitude  that  steadily  rose  to  about  8 x 10~7  degrees  by  the  end  of  the  run. 
Throughout  the  run,  SIM  2 exhibited  a gravitational  acceleration  that  was  approximately  0.05  ft/s2  lower 
than  the  other  simulations.  The  lower  gravity  appeared  to  be  the  primary  cause  of  differences  in  downward 
velocity  and  altitude.  The  lower  gravity  started  a feedback  loop  in  which  velocity  and  altitude  differences 
cascaded  into  differences  in  atmospheric  density,  dynamic  pressure,  and  aerodynamic  drag.  The  difference 
in  aerodynamic  drag  created  further  differences  in  velocity  and  altitude.  In  this  feedback,  a secondary  cause 
of  difference  in  atmospheric  density,  previously  discussed  in  the  “Check-case  1 - dragless  sphere”  scenario, 
was  due  to  implementation  of  the  U.S.  Standard  Atmosphere  1976  model  using  a look-up  table.  These  root 
causes  were  verified  by  altering  SIM  5 to  use  a look-up  table  for  atmospheric  density  and  to  use  an  Earth 
gravitation  constant  that  produced  the  lower  gravity.  The  altered  SIM  5 matched  the  altitude  results  of 
SIM  2 to  within  0.006  ft. 

The  vehicle  in  this  scenario  had  constant  angular  momentum  with  no  external  torques.  Moreover,  because 
the  vehicle  is  a uniform  sphere,  the  inertial  angular  rates  in  body  coordinates  (p,  q,  r)  also  remained  constant. 
All  simulations  exhibited  this  constant  angular  rate.  However,  SIM  2 exhibited  differences  from  the  other 
simulations  in  predicted  Euler  angles.  As  first  suggested  in  the  “Check-case  2 - dragless  tumbling  brick” 
scenario,  the  SIM  2 differences  were  likely  due  to  integration  step  sizes  or  order. 
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D.1.5  Check-case  5 — sphere  dropping  over  rotating,  spherical  Earth 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a sphere 
dropped  with  a fixed  drag  coefficient  through  a still  atmosphere  in  a round  rotating  Earth  with  spherical 
gravity.  This  scenario  is  described  in  Section  C.1.5.  Figures  20a  through  20x  compare  results  between  the 
four  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average 
value. 

This  check-case  scenario  is  identical  to  the  “Check-case  4 - sphere  dropping  over  non-rotating,  spherical 
Earth”  scenario  but  with  the  addition  of  Earth  rotation.  Likewise,  the  differences  between  the  simulations 
were  nearly  the  same  as  in  the  previous  check-case.  Again,  SIM  2 exhibited  a different  trajectory  from  SIM  4, 
5,  and  6 due  to  an  initial  north  velocity  of  0.01  ft/s,  a gravitation  difference  of  approximately  —0.05  ft/s2, 
and  the  linear  table  interpolation  implementation  of  the  atmosphere  model.  With  the  addition  of  Earth’s 
rotation,  SIM  2 also  exhibited  a visible,  though  negligible,  difference  in  longitude  as  the  differences  in 
downward  velocity  induced  a difference  in  Coriolis  acceleration.  Adding  the  Earth’s  rotation  did  not  visibly 
change  differences  in  angular  rates  or  orientation.  All  simulations  agreed  on  angular  rates.  The  predicted 
orientation  in  SIM  2 differed  identically  from  the  previous  atmospheric  case  and  appears  to  have  been  caused 
by  a difference  in  integration  method  used  to  integrate  the  angular  rates. 
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D.1.6  Check-case  6 sphere  dropping  over  rotating,  ellipsoidal  Earth 

This  section  shows  cross-plots  for  six  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a sphere 
dropped  with  a fixed  drag  coefficient  through  a still  atmosphere  in  a ellipsoidal  rotating  Earth  with  Ji 
gravitational  harmonics.  This  scenario  is  described  in  Section  C.1.6.  Figures  21a  through  21x  compare 
results  between  the  six  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each  tool  from  the 
ensemble  average  value. 

This  check-case  was  identical  to  “Check-case  1 - dragless  sphere”  scenario  with  the  addition  of  aerodynamic 
drag.  Since  drag  is  a function  of  both  velocity  and  atmospheric  density  (which,  in  turn,  is  a function 
of  altitude),  this  scenario  could  amplify  differences  in  predicted  velocity  and  altitude  that  were  visible  in 
atmospheric  case  1.  Furthermore,  the  differences  in  atmospheric  density  among  the  simulations  due  to 
choices  of  atmospheric  model  implementation  would  now  have  an  effect  on  translational  dynamics  through 
the  aerodynamic  forces. 

As  discussed  in  atmospheric  check-case  1,  small  differences  in  atmospheric  density  arose  because  simulation 
SIM  3,  4,  5,  and  6 implemented  the  atmosphere  model  using  formulas  and  SIM  1 and  SIM  2 used  look-up 
tables.  Differences  in  aerodynamic  forces  were  consistent  with  differences  in  velocity  and  atmospheric  density 
with  the  exception  of  SIM  2 and  SIM  3. 

SIM  2 and  SIM  3 both  had  additional  contributors  to  differences  in  aerodynamic  forces.  In  the  case  of  SIM  2, 
it  appeared  that  the  aerodynamic  force  lagged  the  other  simulations  by  0.01  sec,  or  one  frame  in  a 100-Hz 
simulation.  This  finding  was  corroborated  by  reconstructing  the  aerodynamic  force  using  the  density  and 
velocity  reported  by  SIM  2.  The  aerodynamic  forces  reported  by  SIM  2 were  best  reconstructed  using  a 
linear  interpolation  of  the  velocity  and  density  delayed  by  0.01  sec.  Though  the  reported  aerodynamic  forces 
lagged  one  frame,  the  differences  in  recorded  velocity  were  smaller  than  would  be  expected  if  this  lag  also 
existed  in  the  EOM.  In  the  case  of  SIM  3,  apparent  differences  in  vehicle  orientation  caused  differences  in 
the  recorded  aerodynamic  forces  and  moments  in  body  coordinates.  Though  SIM  3 did  not  record  angular 
rates  or  Euler  angles,  its  differences  in  the  aerodynamic  y and  z forces  could  be  reproduced  by  assuming  the 
sphere  had  an  initial  Earth  relative  rate  of  zero.  The  other  simulations  initialized  to  an  inertial  rate  of  zero. 

Differences  in  the  other  external  force,  gravitation,  were  consistent  with  differences  in  altitude.  The  combined 
effect  of  differences  in  aerodynamic  and  gravitation  forces  on  the  translational  states  remained  modest.  All 
simulations  agreed  that  there  was  no  northward  velocity.  Likewise,  differences  in  longitude  and  in  eastward 
velocity  (due  to  Coriolis  effect)  were  negligible.  In  the  downward  axis,  the  simulations  did  show  differences 
in  the  range  — 0.07to0.010  ft/s  for  downward  velocity  and  in  the  range  — 0.6fo0.4  ft  for  altitude. 

Among  the  simulations  that  recorded  rotational  states,  there  were  no  visible  differences. 
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D.1.7  Check-case  7 — sphere  dropping  through  a steady  wind  held 

This  section  shows  cross-plots  for  six  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a sphere 
dropped  with  a fixed  drag  coefficient  through  an  steadily  moving  atmosphere  in  an  ellipsoidal  rotating  Earth 
with  J2  gravitational  harmonics.  This  scenario  is  described  in  Section  C.1.7.  Figures  22a  through  22x 
compare  results  between  the  six  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each  tool  from 
the  ensemble  average  value. 

This  atmospheric  check-case  added  a constant  wind  from  the  west  to  the  previous  scenarios.  The  addition 
of  winds  did  not  introduce  new  contributors  to  differences  among  the  simulations.  Differences  visible  for  this 
case  are  nearly  identical  to  the  prior  case: 

• SIM  3,  4,  5,  and  6 implemented  their  atmosphere  models  using  formulas.  SIM  1 and  2 used  lookup 
tables  with  linear  interpolation.  Since  atmospheric  pressure  and  density  are  non-linear  functions,  these 
atmospheric  properties  differed  slightly  between  the  formulaic  and  lookup  tables  results  in-between 
altitude  breakpoints. 

• The  simulations  used  different  numerical  integration  methods  and  exhibited  differences  in  integrated 
and  other  numerical  values 

• The  aerodynamic  forces  recorded  by  SIM  2 appeared  to  lag  the  other  simulations  by  0.01  sec.  However, 
this  appeared  to  be  an  error  only  in  the  recording  process;  translational  states  exhibited  smaller 
differences  than  would  be  expected  if  this  lag  also  existed  in  SIM  2’s  EOM. 

• The  aerodynamic  force  differences  for  SIM  3 were  indicative  of  a difference  in  initial  rotational  rate. 
Though  SIM  3 did  not  record  rotational  states,  the  differences  in  the  aerodynamic  forces  could  be 
matched  if  one  assumed  that  SIM  3 was  initialized  to  a zero  angular  rate  relative  to  the  Earth.  The 
other  simulations  are  initialized  to  an  inertial  angular  rate  of  zero. 

All  differences  visible  between  the  simulations  appear  to  have  been  caused  by  these  contributing  factors. 
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D.1.8  Check-case  8 — sphere  dropping  through  a varying  wind  field 

This  section  shows  cross-plots  for  six  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a sphere 
dropped  with  a fixed  drag  coefficient  through  an  atmosphere  with  wind  velocity  as  a function  of  altitude  over 
an  ellipsoidal  rotating  Earth  with  J2  gravitational  harmonics.  This  scenario  is  described  in  Section  C.1.8. 
Figures  23a  through  23x  compare  results  between  the  six  simulation  tools,  as  well  as  the  deviances  of  the 
outputs  from  each  tool  from  the  ensemble  average  value. 

This  check-case  alters  the  previous  case  by  modeling  winds  as  varying  linearly  with  altitude.  Moreover,  the 
initial  winds  were  higher  (70  ft/s  versus  20  ft/s).  Those  higher  winds  exposed  new  contributors  to  differences 
in  true  airspeed,  dynamic  pressure,  and  aerodynamic  forces  that  are  largely  hidden  in  the  prior  scenarios.  As 
with  the  prior  scenario,  the  initial  winds  were  coming  from  the  west.  Given  the  initial  vehicle  velocity  of  zero 
relative  to  the  Earth,  the  winds  induced  an  initial  drag  eastward.  In  the  chart  for  body  y-axis  aerodynamic 
force  (Figure  23a),  SIM  6 and  SIM  3 recorded  a value  of  zero  at  time  zero.  Furthermore,  SIM  6 recorded 
a value  of  zero  for  true  airspeed  and  dynamic  pressure  at  t = 0 sec;  SIM  3 did  not  record  these  values.  In 
the  case  of  SIM  6,  the  difference  appeared  to  be  a recording  artifact  only;  SIM  6 maintained  a close  match 
in  eastward  velocity  to  other  simulations  at  t = 0.1  sec.  However,  SIM  3 exhibited  a difference  in  initial 
eastward  velocity  from  t = 0 sec  to  t = 0.1  sec  (Figure  23n)  that  is  consistent  with  a starting  aerodynamic 
y- axis  force  of  zero.  This  initial  jump  in  velocity  difference,  in  turn,  caused  a growth  in  the  difference  for 
longitude  (Figure  23f)  and  ECEF  F-axis  position  (Figure  23v)  relative  to  the  differences  seen  in  the  previous 
scenario  (Check-case  7 - sphere  dropping  through  a steady  wind  field). 

Otherwise,  differences  visible  in  the  plots  appeared  to  be  caused  by  the  same  contributors  identified  in  prior 
check-cases. 
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D.1.9  Check-case  9 eastward  ballistic  flight  of  a sphere 

This  section  shows  cross-plots  for  six  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a sphere 
launched  eastward  along  the  Equator  of  an  ellipsoidal  rotating  Earth  with  J2  gravitational  harmonics.  This 
scenario  is  described  in  Section  C.1.9.  Figures  24a  through  24x  compare  results  between  the  six  simulation 
tools,  as  well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

This  scenario  launched  the  sphere  on  a ballistic  trajectory  to  the  east  along  the  Equator.  The  sphere  had 
zero  initial  Earth-relative  velocity  and  angular  rates.  However,  it  developed  a pitch  relative  to  the  Earth 
due  to  the  eastward  travel.  In  fact,  the  change  in  pitch  angle  should  have  been  exactly  equal  to  the  change 
in  longitude. 

All  the  simulations  showed  this  equivalence  between  longitude  and  pitch  angle  differences  except  for  SIM  2. 
Given  previous  integration  error  differences  for  the  Euler  angles  identified  for  SIM  2 in  Section  D.1.2,  it 
was  assumed  that  the  pitch  angle  difference  shown  for  SIM  2 were  due  to  a combination  of  differences  in 
integration  methods  and  longitude  traveled.  In  any  case,  the  differences  in  pitch  angle  were  not  significant. 

The  differences  in  translational  motion  were  larger.  The  simulations  all  agreed  that  no  motion  occurs  to  the 
north.  But  simulations  differed  on  the  amount  of  travel  eastward  and  upward  by  nearly  5 ft  at  t = 30  sec. 
SIM  4,  5,  and  6 closely  agreed  on  gravitation,  aerodynamic  forces,  translational  velocity,  and  position; 
therefore,  these  simulations  were  used  as  a basis  for  evaluating  differences  among  the  remaining  simulations. 
(This  was  not  an  endorsement  that  these  simulations  produce  the  “correct”  result;  this  simply  reduced  the 
number  of  differences  to  analyze.) 

First,  the  external  forces  were  examined  for  the  contributors  to  differences  in  translational  motion.  The 
difference  plot  for  local  gravity  (Figure  24j)  did  portray  a jump  in  the  gravitational  difference  in  SIM  1 and 
SIM  2 at  t = 0.1  sec.  However,  these  differences  would  correspond  to  altitude  differences  of  about  —10  and 
—3.5  ft  respectively  when  compared  to  SIM  3,  4,  5,  and  6.  However,  the  altitude  difference  plot  did  not  show 
any  visible  difference  in  altitude  at  t = 0.1  sec.  An  alternative  explanation  is  an  unknown  delay  in  recording 
gravitation.  This  explanation  matched  well  with  the  difference  seen  in  SIM  2 if  the  recording  delay  was 
0.01  sec.  The  initial  upward  velocity  of  the  sphere  was  1,000  ft/s;  therefore,  a delay  of  0.01  sec  in  recording 
represented  nearly  a — 10-ft  altitude  bias  in  the  gravitation  reported  at  simulation  start.  Moreover,  since 
gravitation  and  aerodynamic  drag  would  reduce  the  upwards  velocity  over  time,  the  altitude  bias  in  the 
reported  gravity  that  was  associated  with  a 0.01-sec  lag  should  decline,  at  least  until  the  sphere  begins  to 
accelerate  back  towards  the  Earth’s  surface.  At  t = 30  sec,  the  sphere  had  passed  the  apex  in  its  trajectory 
but  the  downward  velocity  remained  low.  The  altitude  bias  for  a 0.01-sec  delay  would  be  +1.8  ft.  However, 
at  the  same  time,  SIM  2 showed  an  altitude  difference  that  had  grown  to  approximately  1.4  ft,  relative 
to  the  consensus  group  (SIM  4/5/6)  (Figure  24f).  The  altitude  difference,  therefore,  largely  canceled  the 
altitude  bias  from  the  recording  lag  and  the  difference  in  gravitation  between  SIM  2 and  SIM  4/5/6  at 
t = 30  sec  was  reduced  to  nearly  zero,  as  shown  on  the  plots  (Figure  24j).  The  “recording  delay”  also 
appeared  to  explain  the  gravitation  differences  in  SIM  1 but  the  required  delay  would  have  needed  to  be 
about  0.004  sec.  Furthermore,  SIM  1 did  not  exhibit  a steady  decline  in  gravitation  difference;  instead,  the 
gravitation  difference  exhibited  a slight  increase  over  time  (Figure  24j).  This  likely  occurred  because  the 
altitude  difference  between  SIM  1 and  SIM  4/5/6  was  increasing  in  a direction  that  initially  compensates 
for  and  then  exceeded  the  decline  in  the  lag-induced  altitude  bias. 

Remaining  differences  in  gravitation  among  the  simulations  were  consistent  with  the  plotted  differences  in 
altitude.  In  any  case,  even  if  the  largest  gravitation  differences  (which  appeared  to  be  due  to  recording  delay) 
were  applied  to  the  EOM,  they  would  account  for  differences  in  downward-axis  velocity  and  altitude  of  less 
than  0.0005  ft/s  and  0.009  ft,  respectively,  at  t = 30  sec.  Thus,  gravitation  differences  were  not  a driving 
contributor  to  differences  in  translational  motion. 
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Differences  in  aerodynamic  forces  were  larger  than  those  for  gravitation.  The  differences  in  SIM  2 aerody- 
namic forces  had  two  main  contributors,  a 0.01-sec  delay  in  the  recorded  forces  and  a difference  in  atmospheric 
density.  The  delay  was  a recording  artifact  only  and  did  not  contribute  to  differences  in  velocity  and  position. 
The  difference  in  atmospheric  density,  as  discussed  in  previous  check-cases,  derived  from  implementing  the 
atmosphere  model  using  a lookup  table.  From  the  data,  it  appears  that  SIM  2 used  1,000  m for  the  first 
break-point  but  every  break-point  thereafter  was  at  500-m  increments.  Small  aerodynamic  force  differences 
arising  from  differences  in  atmospheric  density  were  the  primary  contributor  for  differences  in  translational 
motion  between  SIM  2 and  SIM  4/5/6;  they  accounted  for  nearly  all  of  the  differences  in  velocity  (Figure  24n) 
and  position  (Figure  24f)  relative  to  SIM  4/5/6. 

SIM  1 also  used  a lookup  table  to  estimate  atmospheric  density;  the  lookup  table  has  1000-m  breakpoints 
throughout  the  altitudes  traversed  in  this  case.  The  density  difference  was  the  primary  contributor  to  the 
difference  in  aerodynamic  forces  between  SIM  1 and  SIM  4/5/6.  The  evolving  difference  in  velocity  was  a 
secondary  contributor.  However,  the  aerodynamic  force  differences  for  SIM  1 would  account  for  only  61% 
of  the  eastward  velocity  and  longitude  differences,  34%  of  the  downward  velocity  difference,  and  46%  of  the 
altitude  difference. 

The  source  of  the  remaining  difference  between  SIM  1 and  the  SIM  4/5/6  group  in  translational  motion  could 
not  be  identified  from  the  recorded  data.  The  remaining  contributor  appeared  to  be  an  unknown  difference 
in  EOM  implementation  or  configuration  possibly  including,  but  not  limited  to,  differences  in  integration  or 
other  numerical  methods. 

Differences  in  aerodynamic  forces  (Figure  24b)  in  SIM  3 were  largely  a response  to  the  growing  differences 
in  velocity  and  altitude,  which  determined  atmospheric  density.  A small  difference  in  orientation  of  SIM  3 
relative  to  SIM  4/5/6  also  contributed  to  the  differences  in  aerodynamic  forces.  Although  SIM  3 values  for 
Euler  angles  are  not  plotted,  the  SIM  3 data  file  had  a very  small  initial  roll  angle  (—6.4  x 10-6  degrees). 
This  small  roll  angle  likely  explained  the  difference  of  order  1 x 10-'  lbf  seen  in  body  y-axis  aerodynamic 
force  (Figure  24b).  Nevertheless,  the  orientation  difference  did  not  contribute  to  differences  in  translational 
velocity  and  position.  Relative  to  SIM  4/5/6,  the  expected  contributions  of  the  aerodynamic  force  differences 
to  differences  in  translational  motion  at  t = 30  sec  were  +0.14  ft/s  in  eastward  velocity,  +6.4  x 10~6  degrees  in 
longitude,  —0.098  ft/s  in  downward  velocity,  and  +1.8  ft  in  altitude.  However,  the  total  differences  were  larger 
and  in  the  opposite  direction.  They  were  —0.16  ft/s  in  eastward  velocity,  —1.4  x 10-5  degrees  in  longitude, 
+0.14  ft/s  in  downward  velocity,  and  —4.3  ft  in  altitude.  As  with  SIM  2,  the  additional  contributor(s)  to 
these  small  differences  could  not  be  identified  using  the  recorded  data;  it  is  likely  an  unknown  difference 
in  EOM  implementation  or  configuration  including,  but  not  limited  to,  differences  in  integration  or  other 
numerical  methods. 
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D.1.10  Check-case  10  northward  ballistic  flight  of  a sphere 

This  section  shows  cross-plots  for  six  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a sphere 
launched  northward  along  the  Equator  of  an  ellipsoidal  rotating  Earth  with  J2  gravitational  harmonics.  This 
scenario  is  described  in  Section  C.1.10.  Figures  25a  through  25x  compare  results  between  the  six  simulation 
tools,  as  well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

This  check-case  scenario  launched  a sphere  on  a ballistic  trajectory  northward  from  the  Equator.  Due  to 
Coriolis  effects,  the  trajectory  should  have  deflected  slightly  to  the  west.  The  sphere  was  initially  oriented 
with  its  axaxis  to  the  north  and  its  2-axis  pointing  down;  moreover,  the  sphere  had  an  initial  rotation  rate, 
relative  to  the  Earth,  of  zero.  As  a consequence,  the  pitch  angle  should  have  followed  the  change  in  latitude 
and  the  roll  angle  should  have  followed  the  change  in  longitude.  All  the  simulations  agreed  on  the  angular 
rate.  Consequently,  differences  in  latitude  and  longitude  should  be  the  primary  contributors  to  differences 
in  pitch  and  roll  angle.  All  simulations  were  in  agreement  for  both  longitude  and  roll  angle.  However,  the 
differences  in  pitch  angle  (Figure  25h)  did  not  match  differences  in  latitude.  In  fact,  the  differences  for  pitch 
angle  were  larger  than  those  for  latitude  and  they  divided  the  simulations  into  two  camps.  SIM  4 and  SIM  5 
agreed  on  one  value.  SIM  1,  2,  and  6 agreed  on  another  value  that  differed  by  up  to  4.2  x 10-4  degrees  at 
t = 30  sec. 

Membership  in  two  groupings  were  not  coincidental.  The  difference  in  pitch  angle  between  the  two  simulation 
groups  was  identical  to  the  difference  between  geodetic  and  geocentric  latitude.  In  other  words,  the  pitch 
angles  for  SIM  4 and  SIM  5 were  relative  to  a NED  frame  where  the  downward  axis  was  aligned  with  the 
geodetic  normal,  whereas  the  pitch  angle  for  SIM  1,  2,  and  6 is  relative  to  a NED  frame  where  the  downward 
axis  is  aligned  with  the  geocentric  radial. 

This  difference  in  alignment  of  the  NED  frame,  however,  should  have  produced  velocity  differences  in  that 
frame  an  order  of  magnitude  lower  than  the  actual  differences  shown  between  simulations.  The  alignment 
differences  should  contribute  to  a difference  of  +0.001  ft/s  in  northward  velocity  and  —0.004  ft/s  in  downward 
velocity  at  t = 30  sec.  Instead,  the  differences  in  translational  motion  are  nearly  identical  to  those  presented 
in  “Check-case  9 - eastward  ballistic  flight  of  a sphere”  if  one  where  to  swap  the  north  and  east  variables.  One 
exception  is  the  SIM  2 difference  in  latitude,  which  will  be  discussed  later.  Otherwise,  the  same  contributors 
summarized  in  results  for  atmospheric  check-case  7 (Section  D.1.7)  were  present  in  this  check-case. 

SIM  2 exhibited  a difference  in  latitude  relative  to  SIM  4/5,  which  was  dissimilar  to  the  difference  in  longitude 
exhibited  between  these  simulations  in  the  previous  check-case  (Check-case  9 - eastward  ballistic  flight  of  a 
sphere).  Furthermore,  this  difference  of  —2.4  x 10-4  degrees  was  equivalent  to  a distance  of  almost  —90  ft. 
The  SIM  2 difference  in  latitude  did  not  correlate  with  the  difference  in  northward  velocity  which  predicted 
a difference  in  distance  of  —1.7  ft.  Furthermore,  this  difference  of  —1.7  ft  could  be  reproduced  by  comparing 
geocentric  latitude  between  SIM  2 and  SIM  5.  The  SIM  2 data  file  recorded  both  geodetic  and  geocentric 
latitude.  Geocentric  latitude  for  SIM  5 was  derived  from  its  ECEF  position.  At  t = 30  sec,  geocentric 
latitude  between  the  two  simulations  differed  by  —4.6  x 10~6  degrees  which  was  equivalent  to  a distance  of 
— 1.7  ft  at  altitude.  Therefore,  the  difference  in  geodetic  latitude  between  SIM  2 and  the  other  simulations 
was  not  a reflection  of  a difference  in  the  predicted  position  of  the  vehicle.  Instead,  it  appeared  to  be  a 
difference  in  the  accuracy  of  the  method  used  to  compute  the  geodetic  coordinates. 

In  this  check-case,  the  Coriolis  effect  introduces  a drift  westward  which  did  not  have  a parallel  in  the  previous 
check-case  (i.e. , there  was  no  drift  northward).  As  stated  previously,  the  simulations  appeared  to  agree  on 
longitude.  Moreover,  the  differences  in  eastward  velocity  and  ECEF  E-axis  position  were  not  significant  and 
were  likely  due  to  differences  in  integration  methods. 

All  other  differences  between  the  simulations  are  derived  from  the  contributors  discussed  previously. 
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D.1.11  Check  -case  11  — steady  flight  of  a subsonic  aircraft 

This  section  shows  cross-plots  for  two  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  an  aircraft 
in  steady  trimmed  subsonic  flight  on  an  arbitrary  heading.  This  scenario  is  described  in  Section  C.1.11. 
Figures  26a  through  26x  compare  results  between  the  two  simulation  tools,  as  well  as  the  deviances  of  the 
outputs  from  each  tool  from  the  ensemble  average  value. 

This  check-case  was  the  first  of  a series  utilizing  the  F-16  model.  Unlike  the  first  ten  atmospheric  scenarios, 
the  F-16  scenarios  required  that  the  simulation  tool  generate  an  equilibrium  (“trim”)  solution  for  the  F- 
16  vehicle  model  so  that  its  initial  state,  including  control  surface  deflections  and  engine  thrust,  resulted 
in  straight  and  level  flight.  This  equilibrium  solution  requirement  can  introduce  differences  among  the 
simulation  implementations  since  different  simulation  tools  may  have  different  definitions  for  straight  and 
level  flight,  especially  over  the  curved  surface  of  a round  or  ellipsoidal  Earth  reference.  Simulation  tools  may 
also  generate  solutions  with  different  tolerances  for  residual  acceleration. 

Such  differences  can  be  seen  in  the  three  simulations  that  provided  data  for  this  check-case  (see,  for  example, 
Figure  26b).  All  three  simulations  used  slightly  different  assumptions  about  the  angular  rate  necessary  for 
straight  and  level  flight.  SIM  2 constrained  the  angular  rate  to  be  zero  in  the  inertial  frame.  SIM  4 solved 
for  the  pitch  rate  that  maintained  the  pitch  angle  as  the  vehicle  flew  over  the  curved  surface  of  the  Earth. 
SIM  5 solved  for  the  three- axis  angular  rate  that  maintained  the  vehicle  orientation  (i.e.,  all  three  Euler 
angles)  relative  to  the  local  vertical  frame  as  the  vehicle  flies  over  the  curved  surface  of  the  Earth.  Even 
so,  the  equilibrium  roll  and  yaw  rate  computed  by  SIM  5 were  very  small,  3 x 10-5  and  8 x 10-4  deg/s 
respectively.  Therefore,  the  equilibrium  solutions  for  SIM  4 and  SIM  5 were  nearly  identical.  Nevertheless, 
each  simulation  exhibited  an  oscillation  in  angular  rates  during  the  first  second  of  the  simulation.  Differences 
during  the  oscillation  dwarfed  the  initial  attitude  differences.  Once  the  oscillation  settled,  however,  SIM  4 
and  SIM  5 were  in  near  agreement  on  angular  rate  while  the  trajectory  calculated  by  SIM  2 continued  to 
differ  from  SIM  4/5. 

The  initial  roll  and  pitch  angle  in  SIM  2 also  differed  from  SIM  4/5  (Figure  26g).  The  root  cause  was  a 
difference  in  the  simulated  gravity  vector.  SIM  2 employed  a simplification  that  creates  a gravity  vector  that 
is  slightly  deflected  from  the  surface  normal.  (As  discussed  in  Section  B.4,  the  terms  gravitation  and  gravity 
have  different  meanings:  gravitation  is  the  force  from  the  attraction  of  two  masses;  gravity  is  the  sum  of 
gravitation  and  the  centrifugal  acceleration  due  to  the  Earth’s  rotation.  Gravity  is  the  acceleration  of  a body 
in  free  fall  measured  by  an  observer  stationed  on  the  surface  of  the  Earth.)  All  three  simulations  computed 
the  geocentric  gradient  of  the  Ji  gravitation  potential,  which  produced  gravitation  in  the  geocentric  down 
direction  and  a much  smaller  contribution  in  the  geocentric  north  direction.  However,  as  first  identified  in 
atmospheric  check-case  9 (Section  D.1.9),  SIM  2 approximated  the  geodetic  NED  frame  as  the  geocentric 
frame  to  use  the  geocentric  frame  as  the  local  vertical  reference  frame  when  computing  gravity.  SIM  4 
and  SIM  5 translated  the  geocentric  gravitation  vector  into  a geodetic  gravitation  vector.  This  rotation 
was  necessary  to  produce  a gravitation  vector  where  the  resulting  small  geodetic  north-axis  component  of 
gravitation  was  canceled  by  the  geodetic  north-axis  contribution  of  centrifugal  acceleration  due  to  the  Earth’s 
rotation.  This  resulted  in  a gravity  vector  whose  direction  matched  the  geodetic  down-axis  direction  almost 
exactly.  Without  the  rotational  contribution,  the  gravitation  and  centrifugal  acceleration  combined  to  create 
a gravity  vector  slightly  deflected  from  the  geocentric  downward  direction.  That  deflection  was  equal  to  the 
difference  between  the  geodetic  and  geocentric  latitude  since  the  true  direction  of  the  gravity  vector  is  along 
the  geodetic  normal. 

In  the  initial  position  specified  by  this  check-case,  the  resulting  gravity  vector,  in  geocentric  coordinates,  is 
deflected  0.18  degrees  southward  of  the  radial  vector.  That  deflection  amount  was  approximately  equal  to 
the  difference  in  roll  angle  between  SIM  2 and  SIM  4/5. 
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The  equilibrium  solver  for  SIM  2 appeared  to  roll  the  vehicle  slightly  so  that  its  aerodynamic  lift  was  more 
closely  aligned  with  the  slightly  non-vertical  gravity  vector.  The  SIM  2 equilibrium  solver  also  produced  a 
slightly  different  pitch  angle  because  the  aerodynamic  lift  required  for  the  trim  solution  differed  slightly  from 
those  of  SIM  4/5.  With  a non-zero  roll  angle,  eliminating  vertical  acceleration  in  SIM  2 required  balancing 
contributions  from  weight,  thrust,  lift,  drag,  and  aerodynamic  side  force.  When  the  roll  angle  was  zero,  as 
in  SIM  4 and  5,  no  significant  aerodynamic  side  force  was  generated. 

Even  if  SIM  2 were  modified  to  use  a geodetic  gravity  vector,  the  difference  plot  for  gravitation  (Figure  26i) 
shows  that  there  would  remain  a small  difference  in  gravitation  of  1.8  x 10-4  ft/s2.  There  should  be  no 
difference  in  Earth  parameters  among  the  simulations  given  the  match  in  J2  gravitation  for  atmospheric 
case  1 (see  Section  D.1.1).  What  remains  as  a possible  explanation  of  this  difference  in  gravitation  could 
be  a difference  in  the  conversion  from  the  initial  geodetic  coordinates  to  an  initial  geocentric  position.  The 
difference  could  be  significant.  For  example,  a difference  of  —58  ft  in  the  distance  of  the  vehicle  from  Earth’s 
center  would  produce  the  same  change  in  magnitude.  Nevertheless,  the  difference  in  magnitude  should  be 
a minor  contributor  to  the  vehicle  dynamics  as  it  adds  only  0.11  lbf  to  the  weight  of  the  20,500  lb  F-16 
example  vehicle. 

Differences  in  initial  angular  rates  would  induce  differences  in  the  aerodynamic  forces  and  moments.  However, 
those  differences  were  very  small  and  were  dwarfed  by  other  contributors  including  the  contribution  from 
the  angular  rate  oscillation  in  the  first  second  of  the  simulation. 

A substantial  difference  in  the  plotted  aerodynamic  moments  (26c)  is  the  result  of  a difference  in  the  reference 
location  for  recording  aerodynamic  moments.  When  recording  the  aerodynamic  moments,  SIM  2 recorded 
moments  about  the  aerodynamic  MRC;  SIM  4 and  5 recorded  the  aerodynamic  moment  at  the  vehicle  CM 
after  these  had  been  transferred  from  the  MRC.  This  difference  appears  in  the  aerodynamic  moment  plots 
for  all  the  F-16  cases  hereafter;  it  just  reflects  a lack  of  agreement  on  which  moment  vector  to  record. 

Even  when  the  moments  were  adjusted  for  differences  in  the  reference  point,  a difference  in  the  initial 
aerodynamic  yaw  and  pitching  moments  remained  between  SIM  2 and  SIM  4/5  at  the  MRC;  furthermore, 
SIM  2 also  differed  in  the  initial  aerodynamic  forces  (Figures  26a).  These  differences  resulted  from  the 
difference  in  the  gravity  vector  as  described  in  the  previous  paragraph.  With  the  gravity  vector  deflected 
from  the  local  vertical  in  SIM  2,  SIM  2 required  a trade-off  in  pitch  angle  and  roll  angle  to  create  the 
right  combination  of  angle  of  attack  and  sideslip  such  that  the  resulting  aerodynamic  lift  and  side  force 
counteracted  the  gravity  vector  while  leaving  no  residual  force  in  the  horizontal  plane.  As  discussed  above, 
the  result  is  a roll  angle  that  nearly  aligned  the  body  z-axis  with  the  deflected  gravity  vector.  The  differing 
lift  required  a different  aerodynamic  pitching  moment  to  counteract  the  lift-induced  pitching  moment  at  the 
CM.  The  resulting  aerodynamic  side  force  also  induced  a yawing  moment  at  the  CM  and  therefore  required 
a counteracting  aerodynamic  yawing  moment,  which  was  not  present  in  SIM  4 and  SIM  5.  That  yawing 
moment  was  achieved,  in  SIM  2,  by  setting  the  rudder  to  a non-zero  initial  value. 

The  above  differences,  in  general,  set  SIM  2 on  a different  trajectory  from  SIM  4 and  SIM  5.  After  180  sec, 
the  difference  in  vehicle  positions  between  SIM  2 and  SIM  4/5  was  approximately  666  ft  according  to  the 
recorded  values  of  latitude,  longitude,  and  altitude.  The  position  difference  between  SIM  4 and  5 at  the  end 
of  the  scenario  was  two  orders  of  magnitude  smaller,  at  approximately  4 ft. 
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D.1.12  Check-case  12  — steady  flight  of  a supersonic  aircraft 

This  section  shows  cross-plots  for  two  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  an  aircraft 
in  steady  trimmed  supersonic  flight  on  an  arbitrary  heading.  This  scenario  is  described  in  Section  C.1.12. 
Figures  27a  through  27x  compare  results  between  the  two  simulation  tools,  as  well  as  the  deviances  of  the 
outputs  from  each  tool  from  the  ensemble  average  value. 

This  check-case  was  the  same  as  the  previous  check-case  (Check-case  11  - steady  flight  of  a subsonic  aircraft) 
except  that  the  F-16  was  initialized  with  a supersonic  initial  velocity.  The  different  initial  conditions  and 
trajectories  visible  in  the  plots  were  due  to  the  same  contributors  discussed  in  atmospheric  check-case  11: 

• The  simulations  trimmed  to  different  initial  rotation  rates  (see  Figure  27q).  SIM  2 constrained  the 
simulation  to  a zero  inertial  rotation  rate.  SIM  4 forced  pitch  rate  to  hold  a constant  pitch  angle  as 
the  vehicle  flew  over  the  curved  surface  of  the  Earth.  SIM  5 computed  the  three-axis  rotation  rate 
required  to  maintain  three-axis  orientation  (roll,  pitch,  and  yaw)  as  the  aircraft  flies  over  the  curved 
surface  of  the  Earth.  In  the  subsonic  check-case  (Section  D.1.11),  the  resulting  roll  and  yaw  rate  for 
SIM  5 were  near  zero;  thus,  SIM  4 and  SIM  5 could  be  said  to  have  had  a nearly  equal  initial  angular 
rate.  However,  in  the  supersonic  case,  the  roll  rate  computed  by  SIM  5 was  of  the  same  order  as  the 
pitch  rate.  Nevertheless,  the  first  second  of  simulated  flight  continued  to  be  marked  by  oscillations  in 
the  angular  rates,  indicating  less  than  ideal  trim,  and,  as  Figure  27q  shows,  SIM  4 and  SIM  5 settled 
to  the  same  angular  rates.  Thus,  the  difference  in  initial  roll  rate  did  not  substantially  contribute  to 
trajectory  differences  between  SIM  4 and  5. 

• SIM  2 recorded  aerodynamic  moments  at  the  MRC.  SIM  4 and  SIM  5 recorded  these  at  the  vehicle 
CM  (see  Figure  27c). 

• SIM  2 approximated  the  geocentric  frame  as  being  locally  vertical.  This  resulted  in  a gravity  vector 
that  was  deflected  from  local  vertical  by  the  difference  between  geocentric  and  geodetic  latitude.  This 
deflected  gravity  vector  caused  the  SIM  2 equilibrium  solver  to  roll  the  vehicle  slightly  so  that  lift 
was  more  closely  aligned  with  the  direction  of  gravity.  The  equilibrium  solution  also  included  an 
aerodynamic  side  force  that  generated  a yawing  moment  at  the  CM.  The  equilibrium  solution  added 
rudder  deflection  to  create  a counter-acting  aerodynamic  yawing  moment.  The  use  of  a non- vertical 
gravity  vector  in  SIM  2 led  to  a difference  in  the  initial  values  for  roll  angle,  pitch  angle,  aerodynamic 
forces,  aerodynamic  pitching  moment,  and  aerodynamic  yawing  moment. 

• Even  were  SIM  2 modified  to  use  the  geodetic  (instead  of  geodetic)  gravitation  vector,  SIM  2 produced 
a J2  gravitation  vector  that  differed  in  magnitude  from  the  other  simulation  results  by  1.8  x 10~4  ft/s2. 
The  best  explanation  for  this  may  have  been  a difference  in  the  conversion  of  initial  conditions  from 
geodetic  to  geocentric  coordinates.  The  difference  in  the  geodetic  coordinates  would  have  to  represent 
an  altitude  difference  of  58  ft  or  greater.  However,  the  difference  in  gravitation  itself  should  have  made 
a very  small  impact  on  vehicle  dynamics  as  it  added  only  0.11  lbf  to  the  weight  of  the  vehicle. 

Overall,  the  change  from  subsonic  to  supersonic  speed  did  moderately  increase  the  position  difference  between 
the  simulations  after  180  sec.  SIM  4 and  SIM  5 were  separated  by  7.5  ft.  SIM  2 was  separated  from  the 
other  two  simulations  by  760  ft,  based  on  the  recorded  differences  in  latitude,  longitude,  and  altitude. 
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D.1.13  Check-case  13.1  — altitude  change  of  a subsonic  aircraft 

This  section  shows  cross-plots  for  three  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a subsonic 
aircraft  performing  an  altitude  change.  This  scenario  is  described  in  Section  C.1.13.  Figures  28a  through 
28x  compare  results  between  the  three  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each 
tool  from  the  ensemble  average  value. 

This  check-case  used  the  same  initial  conditions  as  “Check-case  11  - steady  flight  of  a subsonic  aircraft” 
(Section  D.1.11)  but  was  flown  with  the  simple  F-16  autopilot  (described  in  Section  B.1.5)  engaged  and 
commanded  to  perform  an  altitude  change  of  +100  ft  at  t = 5 sec.  Furthermore,  the  simulation  duration 
was  shortened  to  20  sec.  The  contributors  to  differences  identified  in  atmospheric  check-case  11  were  also 
contributors  to  differences  here.  However,  the  autopilot  quickly  reduced  their  effect  on  differences  in  velocity 
and  vehicle  trajectory.  Nevertheless,  just  as  the  equilibrium  solvers  resolved  to  different  initial  states  due  to 
these  contributors,  the  autopilot  arrived  at  different  steady-state  solutions  among  the  simulations.  Specif- 
ically, SIM  2 used  the  geocentric  frame  as  the  local  vertical  and,  as  a result,  experienced  a gravity  vector 
that  was  deflected  from  the  normal  by  the  difference  between  geocentric  and  geodetic  latitude,  as  described 
in  check-case  11.  In  this  scenario,  the  difference  was  0.18  degrees.  As  a result,  the  steady-state  conditions 
achieved  with  the  autopilot  engaged  has  the  following  differences  between  SIM  2 and  SIM  4/5: 

• SIM  2 settled  to  an  orientation  that  differed  slightly  from  that  of  SIM  4 and  SIM  5 because  a steady- 
state  solution  was  required  to  partly  align  the  body  z-axis  with  the  deflected  gravity  vector.  Thus, 
the  roll  angle  settled  to  a value  different  from  SIM  4/5  by  —0.14  degrees,  but  this  was  a slight  im- 
provement over  the  initial  difference  in  roll  angle  of  —0.17  degrees.  The  yaw  angle  settled  to  a smaller 
difference  between  simulations  of  0.018  degrees.  The  pitch  angle  difference,  however,  was  nearly  zero 
at  —0.003  degrees.  (See  Figure  28g.) 

• The  steady-state  aerodynamic  forces  for  SIM  2 included  a small  side  force  of  3.3  lbf  and  a reduced 
lift  of  —1.1  lbf  in  comparison  to  SIM  4 and  5.  Furthermore,  the  steady-state  solution  created  a 
small  aerodynamic  yawing  moment  at  the  MRC  to  counteract  the  moment  at  the  CM  induced  by  the 
aerodynamic  side  force. 

As  in  atmospheric  check-cases  11  (Section  D.1.11)  and  12  (Section  D.1.12),  the  initial  magnitude  of  the 
gravitation  vector  differed  from  the  other  two  simulations  by  1.8  x 10-4  ft/s2,  indicating  a possible  differ- 
ence in  the  computation  of  the  geocentric  radial  and  geocentric  latitude  used  to  compute  gravitation  (see 
Figure  28i).  However,  no  significant  contribution  to  differences  in  the  vehicle  dynamics  was  expected  from 
the  difference  in  the  magnitude  of  gravitation  as  it  only  added  0.11  lbf  to  the  weight  of  the  vehicle. 

There  are  two  reasons  why  the  autopilot’s  steady-state  solution  differed  in  some  respects  from  the  equilibrium 
solution  at  t = 0.  First,  SIM  2 constrained  the  equilibrium  solver  to  an  inertial  angular  rate  of  zero.  The 
autopilot  solution  is  free  to  reach  a solution  where  the  Earth-relative  angular  rate  is  zero  (instead  of  the 
equilibrium  solver’s  apparent  zero  inertial  rate  constraint).  In  fact,  the  difference  in  angular  rate  between 
SIM  2 and  SIM  5 at  t = 20  sec  was  about  one  quarter  of  the  Earth’s  rotation  rate  and  that  residual  difference 
may  be  a consequence  of  SIM  2 having  treated  the  geocentric  frame  as  the  local  vertical.  The  second  reason 
is  that  the  SIM  2 equilibrium  solver,  like  that  for  SIM  4 and  SIM  5,  constrained  the  heading  to  45°,  but  the 
autopilot  heading  command  actually  attempted  to  maintain  ground  track  at  45°.  The  autopilot  is  free  to 
allow  some  variance  in  yaw  angle  while  counterbalancing  vehicle  forces.  Thus,  the  autopilot  induced  sideslip 
by  both  rolling  and  yawing  the  vehicle  whereas  the  equilibrium  solution  induced  sideslip  through  roll  angle 
alone. 

As  in  atmospheric  check-cases  11  (Section  D.1.11)  and  12  (Section  D.1.12),  SIM  2 recorded  aerodynamic 
moments  at  the  MRC  while  the  other  two  simulations  recorded  aerodynamic  moments  at  the  vehicle  CM. 
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Therefore,  Figure  28q  shows  positive  aerodynamic  pitching  and  yawing  moments  for  SIM  2 while  the  moments 
for  SIM  4 and  5 are  nearly  zero. 

The  introduction  of  the  autopilot  control  generated  some  smaller  contributions  to  the  differences  among 
simulations.  In  the  control  law  implementation,  the  eventual  steady-state  of  the  vehicle  was  a balance 
achieved  between  the  competing  objectives  of  the  autopilot  and  the  LQR  stability  controller.  The  LQR 
stability  controller  attempted  to  keep  the  vehicle  in  the  neighborhood  of  a trim  state  defined  by  predetermined 
values  for  unperturbed  throttle,  longitudinal  stick,  angle  of  attack,  pitch  attitude,  and  airspeed,  while  the 
autopilot  outer-loop  controller  attempted  to  follow  commands  for  altitude,  airspeed,  and  ground  track. 

The  F-16  control  law  documentation  (Section  B.1.5)  included  inputs  to  update  the  default  trim  values  for 
the  throttle  and  longitudinal  stick  with  values  computed  by  the  simulation’s  equilibrium  solver.  But  it  was 
also  possible  to  replace  the  hard-coded  reference  state  values  for  angle  of  attack,  pitch  attitude,  and  airspeed 
with  values  calculated  by  the  equilibrium  solver  in  the  LQR  algorithm  as  well.  All  the  simulations  provided 
values  for  trimmed  throttle  and  longitudinal  stick.  But,  only  SIM  5 replaced  the  hard-coded  LQR  reference 
state  values  for  angle  of  attack,  pitch  attitude,  and  airspeed.  Thus,  small  differences  in  autopilot  results 
could  arise  with  differences  in  the  modification  of  the  trim  values  used  internally  by  the  LQR  controller. 

One  such  difference  was  the  difference  in  velocity  predicted  by  SIM  4 and  SIM  5 (see  Figure  281).  Upon 
engaging  the  autopilot  at  the  start  of  the  simulation,  SIM  4 exhibited  an  immediate  reduction  in  airspeed 
of  —0.11  ft/s.  This  reduction  was  caused  by  the  difference  between  the  internal  LQR  state  reference  value 
of  287.8  KEAS  and  the  trim  solver’s  speed  of  287.98  KEAS,  a difference  of  almost  0.30  ft/s.  The  combined 
inner-  and  outer-loop  control  law  found  a balance  between  the  commanded  airspeed  and  the  internal  reference 
value  by  approximately  splitting  the  difference.  This  velocity  difference  persisted  for  the  remainder  of  the 
run  and  accounted  for  nearly  all  of  the  2.5-ft  horizontal  position  difference  between  SIM  4 and  SIM  5 at  the 
end  of  the  simulated  maneuver  (t  = 20  sec). 

The  gravity  and  initial  angular  rate  differences  in  SIM  2,  described  above,  injected  enough  change  into  the 
autopilot  solution  that  it  is  not  possible  to  identify  the  contribution,  if  any,  caused  by  differences  between 
SIM  2 trimmed  and  LQR  internal  state  values  to  differences  in  velocity  and  position.  Nevertheless,  under 
control  of  the  autopilot,  the  difference  in  trajectory  for  SIM  2 shrank  considerably  compared  to  open-loop 
flight  in  atmospheric  check-case  11  (Section  D.1.11).  The  position  difference  between  SIM  2 and  SIM  5 after 
20  sec  is  19  ft  based  on  the  recorded  differences  in  latitude,  longitude,  and  altitude  (Figure  28e).  In  any 
case,  the  autopilot  succeeded  in  making  the  100-ft  altitude  change  under  all  the  simulations  while  keeping 
the  airspeed  and  track  angle  close  to  the  commanded  values. 
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D.1.14  Check-case  13.2  velocity  change  of  a subsonic  aircraft 

This  section  shows  cross-plots  for  three  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a subsonic 
aircraft  performing  an  airspeed  change.  This  scenario  is  described  in  Section  C.1.14.  Figures  29a  through 
29x  compare  results  between  the  three  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each 
tool  from  the  ensemble  average  value. 

Atmospheric  check-case  13.2  had  the  same  starting  condition  as  the  previous  check-case  but  replaced  the 
altitude  change  maneuver  with  a command  to  decrease  speed  5 kt  to  282.98  KEAS  at  t = 5 sec.  However, 
some  early  assessment  plans  conflicted  with  later  versions  on  the  magnitude  of  the  change  and,  in  initial 
runs,  SIM  5 and  SIM  2 performed  speed  changes  twice  as  large.  In  the  results  presented,  SIM  5 results  were 
updated  for  a —5  kt  speed  change.  But  SIM  2 results  have  not  been  updated.  This  difference  in  commanded 
speed  change  is  the  dominant  contributor  to  the  difference  in  vehicle  velocity  and  trajectory  for  SIM  2 after 
t = 7.5  sec.  Differences  among  the  simulations  in  the  first  few  seconds  were  similar  to  those  in  atmospheric 
check-case  13.1  with  the  same  set  of  contributors.  Moreover,  those  contributors  continue  to  explain  the 
differences  with  SIM  4 and  SIM  5 throughout  the  run: 

• SIM  2 used  the  geocentric  frame  for  the  local  vertical,  leading  to  small  non-zero  values  in  the  initial 
equilibrium  condition  in  roll,  angle  of  sideslip,  and  rudder  deflection,  as  well  as  a slight  difference  in 
initial  yaw  angle. 

• A different  approach  was  taken  in  SIM  5 in  the  modification  of  the  internal  reference  state  values  for 
the  LQR  controller  for  angle  of  attack,  pitch  attitude,  and  velocity  states  to  match  the  values  from  the 
equilibrium  solution  for  the  initial  conditions. 

• SIM  2 recorded  the  aerodynamic  moments  at  the  MRC,  versus  at  the  CM  for  SIM  4 and  5,  leading  to 
the  large  differences  shown  in  Figure  29c. 

• SIM  2 differed  from  SIM  4 and  5 in  the  magnitude  of  the  gravitation  vector  by  1.8  x 10-4  ft/s2,  possibly 
due  to  a different  way  to  initialize  the  initial  position  from  the  specified  geodetic  coordinates;  this  is 
believed  to  have  been  only  a minor  contributor  to  differences  in  vehicle  dynamics. 

The  larger  commanded  airspeed  change  used  by  SIM  2 affected  more  than  just  horizontal  velocity  and 
position.  The  lower  speed  required  a larger  angle  of  attack  to  maintain  lift,  and  thus  a larger  pitch  angle. 
This  is  likely  the  reason  for  an  observed  0.185-degree  difference  in  pitch  angle  for  SIM  2 by  the  end  of  the 
run.  The  lower  speed  also  induced  a drop  in  altitude  which  may  represent  a change  in  the  balance  between 
the  competing  objectives  of  the  autopilot  and  LQR  controller.  SIM  4 and  SIM  5 lost  approximately  3 ft  of 
altitude  in  the  course  of  the  simulated  run.  SIM  2 lost  about  6.6  ft  of  altitude  (see  Figure  29e). 

At  the  end  of  the  run,  the  simulated  vehicles  in  SIM  4 and  SIM  5 were  separated  by  a distance  of  2.2  ft. 
SIM  2’s  F-16  position  was  offset  from  those  of  SIM  4 and  SIM  5 by  distances  of  135  ft  and  137  ft,  respectively. 
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D.1.15  Check-case  13.3  course  change  of  a subsonic  aircraft 

This  section  shows  cross-plots  for  three  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a subsonic 
aircraft  performing  a heading  change.  This  scenario  is  described  in  Section  C.1.15.  Figures  30a  through  30x 
compare  results  between  the  three  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each  tool 
from  the  ensemble  average  value. 

Atmospheric  check-case  13.3  had  the  same  starting  condition  as  check-case  13.1  (Section  D.1.13)  but  per- 
formed a heading  change  instead  of  an  altitude  change.  The  command  to  change  heading  15°  right  from  the 
initial  heading  occurs  at  t = 15  sec.  All  simulations  accomplished  the  heading  change  while  maintaining  the 
commanded  altitude  and  airspeed.  The  results  exhibit  differences  similar  to  those  in  atmospheric  case  13.1 
with  the  same  set  of  contributing  causes: 

• SIM  2 used  the  geocentric  frame  for  the  local  vertical,  leading  to  small  non-zero  values  in  the  initial 
equilibrium  condition  in  roll,  angle  of  sideslip,  and  rudder  deflection,  as  well  as  a slight  difference  in 
initial  yaw  angle. 

• This  steady-state  roll  angle  and,  under  the  command  of  the  autopilot,  the  difference  in  yaw  angle 
produced  a small  sideslip  in  SIM  2 that  generated  an  aerodynamic  side  force  of  about  4 lbf.  That 
aerodynamic  side  force  induced  a moment  at  the  CM  that  required  a counteracting  aerodynamic  yawing 
moment.  In  this  scenario,  however,  all  the  simulations  end  the  check-case  with  a negative  yawing 
moment  at  the  CM  because  they  are  still  (asymptotically)  completing  the  heading  change.  However, 
the  difference  in  the  aerodynamic  yawing  moment  between  SIM  2 and  SIM  5 is  approximately  the 
additional  yawing  moment  needed  to  counteract  the  moment  induced  by  the  aerodynamic  side  force. 

• As  noted  previously,  a different  approach  was  taken  in  SIM  5 in  the  modification  of  the  internal 
reference  state  values  for  the  LQR  controller  for  angle  of  attack,  pitch  attitude,  and  velocity  states  to 
match  the  values  from  the  equilibrium  solution  for  the  initial  conditions. 

• As  noted  previously,  SIM  2 recorded  aerodynamic  moments  at  the  MRC,  while  SIM  4 and  5 recorded 
the  aerodynamic  moments  at  the  vehicle  center  of  gravity,  leading  to  differences  shown  in  Figure  30c. 

• As  noted  previously,  SIM  2 differs  from  SIM  4 and  5 in  the  magnitude  of  the  gravitation  vector  for 
unexplained  reasons,  possibly  due  to  a different  way  used  to  initialize  the  initial  position  from  the 
specified  geodetic  coordinates,  a non-trivial  problem  (see  Section  B.2.3). 

A new  difference  emerged  between  SIM  4 and  SIM  5 in  the  heading  change  scenario.  After  the  change  in 
heading  is  commanded,  the  track  angle  for  SIM  5 quickly  led  that  of  SIM  4 by  0.114°;  over  the  course  of  the 
turn  the  lead  diminished  to  0.002°  at  t = 30  sec.  This  lead  might  have  been  caused  by  the  modification  of 
the  internal  LQR  reference  state  values  or  by  a different  execution  rate  for  the  control  law.  This  lead  in  track 
angle  accounted  for  a little  more  than  half  the  position  difference  that  developed  between  SIM  4 and  SIM  5. 
On  the  other  hand,  SIM  2 fluctuated  between  a leading  and  lagging  track  angle  relative  to  SIM  5 during 
the  first  3 sec  of  the  turn.  The  position  difference  slowly  increased  from  a lag  in  the  next  7 sec  to  a track 
angle  lead  for  the  last  5 sec  of  the  run.  At  the  end  of  run,  the  SIM  2 track  angle  had  a lead  of  0.023°.  This 
behavior  might  have  been  caused  by  a combination  of  the  deflected  gravity  vector,  different  internal  LQR 
reference  state  values,  and/or  differences  between  simulations  in  the  frame  rate  of  the  control  law  algorithm. 

At  the  end  of  the  run,  SIM  4 and  SIM  5 were  separated  by  a distance  of  5.4  ft.  SIM  5 and  SIM  2 were 
separated  by  a distance  of  14.3  ft.  SIM  2 and  SIM  4 were  separated  by  a distance  of  19.1  ft. 

At  the  end  of  the  run,  the  simulated  vehicles  in  SIM  4 and  SIM  5 were  separated  by  a distance  of  5.4  ft, 
while  the  position  of  the  F-16  in  the  trajectory  generated  by  SIM  2 was  offset  from  those  of  SIM  4 and  SIM  5 
by  135  ft  and  137  ft,  respectively. 
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D.1.16  Check-case  13.4  lateral  offset  maneuver  of  a subsonic  aircraft 

This  section  shows  cross-plots  for  three  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a subsonic 
aircraft  performing  a lateral  offset.  This  scenario  is  described  in  Section  C.1.16.  Figures  31a  through  31x 
compare  results  between  the  three  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each  tool 
from  the  ensemble  average  value. 

This  check-case  has  the  same  starting  conditions  as  check-case  13.1  but  replaced  the  command  to  change 
altitude  with  a command  to  execute  a 2,000-ft  lateral  offset  to  the  right  of  the  initial  path.  The  command 
took  effect  at  t = 20  sec. 

The  predicted  trajectories  of  all  three  tools  are  asymptotically  approaching  the  commanded  2,000-ft  offset 
at  the  end  of  the  run  (f  = 60  sec).  At  this  point,  the  simulations  report  a slight  and  decreasing  deviation 
of  between  +0.14°  and  +0.21°  from  the  commanded  heading  of  45°  degrees.  The  simulations  are  also 
approximately  maintaining  the  commanded  altitude  and  airspeed  during  the  run. 

The  following  differences  identified  in  atmospheric  case  13.1  remain  present  in  this  case: 

• SIM  2 used  the  geocentric  frame  for  the  local  vertical.  As  a result,  the  gravity  vector  was  deflected  by 
the  trim  solver  by  the  0.18°  difference  between  the  geocentric  and  geodetic  latitude.  This  caused  the 
equilibrium  solution  for  SIM  2 to  roll  the  aircraft  so  that  the  body  z-axis  (and  therefore  the  aerodynamic 
lift  force)  was  nearly  aligned  with  the  deflected  gravity  vector.  It  also  influenced  the  difference  in  roll 
angle  between  SIM  2 and  the  other  simulations  at  the  end  of  the  run.  Those  differences  are  between 
—0.14°  and  —0.16°.  However,  these  differences  are  not  visible  in  the  charts  due  to  the  larger  transient 
differences  in  roll  angle  that  occur  in  the  first  few  seconds  after  the  simulations  initiate  the  lateral 
offset.  Those  large  transient  differences  are  primarily  driven  by  other  causes. 

• As  in  the  prior  autopilot  check-cases,  the  initial  roll  angle  of  SIM  2 induced  a small  sideslip  that 
generates  an  aerodynamic  side  force  of  about  7.2  lbf.  That  aerodynamic  side  force  induced  a moment 
at  the  CM  that  requires  a counteracting  aerodynamic  yawing  moment  of  8.2  lbf-ft.  For  the  other 
simulations,  the  side  force  and  yawing  moment  at  the  MRC  are  nearly  zero.  However,  these  differences 
were  again  overshadowed  by  larger  transient  differences  in  aerodynamic  forces  and  moments  which 
occur  in  the  first  few  seconds  of  executing  the  lateral  offset. 

• As  in  earlier  check-cases,  differences  exist  among  the  predicted  trajectories  due  to  treatment  of  the 
default,  unperturbed,  state  reference  values  for  the  LQR  controller.  Specifically,  the  LQR  state  refer- 
ence value  for  throttle  and  longitudinal  stick  may  differ  from  the  results  of  the  equilibrium  solver  for 
each  simulation.  Moreover,  only  SIM  5 also  replaced  these  LQR  state  reference  values  for  a,  0,  and  V 
with  its  equilibrium  solution.  The  final  state  of  the  vehicle  under  control  of  the  autopilot  is  a balance 
between  the  autopilot  and  LQR  commands.  The  default  trim  value  for  airspeed  was  0.18  kt  lower 
than  the  initial  speed  specified  for  the  scenario.  Because  SIM  4 didn’t  replace  the  LQR  trim  value 
for  airspeed,  it  experienced  an  immediate  0.11-ft/s  decrease  in  speed  when  the  autopilot  was  engaged. 
This  drop  in  airspeed  persisted  for  the  remainder  of  the  scenario  and  is  a major  contributor  to  the 
growing  distance  between  SIM  4 and  SIM  5.  Differences  in  LQR  trim  values  may  also  influence  the 
results  for  SIM  2;  however,  such  differences  are  overshadowed  by  other  contributors. 

• As  in  earlier  check-cases,  SIM  2 recorded  the  aerodynamic  moments  about  the  MRC;  SIM  4 and  5 
recorded  the  aerodynamic  moments  about  the  vehicle  CM.  Thus,  SIM  4 and  SIM  5 recorded  pitching 
moments  near  zero  when  the  vehicle  is  not  maneuvering  whereas  SIM  2 recorded  non-zero  pitching 
moment  throughout  the  run. 
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• As  in  earlier  check-cases,  SIM  2 differs  from  SIM  4 and  5 in  the  magnitude  of  the  gravitation  vector  by 
1.8  x 1CT4  ft/s2.  A substantial  difference  in  geocentric  location  would  be  necessary  to  cause  this  differ- 
ence in  gravitation.  But,  the  gravitation  difference  itself  would  be  a minor  contributor  to  differences 
in  vehicle  dynamics  since  it  adds  only  0.11  lbf  to  the  weight  of  the  aircraft. 

Unique  to  this  check-case,  the  three  participating  simulation  tools  demonstrated  large  transient  differences 
in  Euler  angles  (Figure  31h),  angular  rates  (Figure  31r),  NED  velocity  (Figure  31n),  and  aerodynamic  forces 
(Figure  31b)  and  moments  (Figure  31d)  in  the  first  few  seconds  after  commanding  the  lateral  offset.  These 
differences  may  have  arisen  from  differences  in  the  execution  rate  of  the  autopilot,  differences  in  LQR  state 
reference  values,  differences  in  the  methods  used  by  each  simulation  to  estimate  the  current  lateral  offset,  or 
from  the  influence  of  differences  of  the  integration  methods  on  the  feedback  response  of  the  controller.  The 
data  sets  do  not  provide  sufficient  information  to  further  investigate  these  potential  causes. 

At  the  end  of  the  run,  SIM  4 and  SIM  5 were  separated  by  a distance  of  11.6  ft.  SIM  5 and  SIM  2 were 
separated  by  a distance  of  40.3  ft.  SIM  2 and  SIM  4 were  separated  by  a distance  of  31.8  ft.  The  distance 
between  SIM  4 and  SIM  5 is  partly  due  to  the  difference  in  airspeed;  the  difference  in  airspeed  alone  would 
create  a separation  of  6.8  ft.  The  remaining  difference  is  the  result  of  differences  in  track  over  the  course  of 
the  run.  For  the  last  30  sec,  the  two  simulations  differ  in  heading  by  an  average  of  0.04°.  Although  that 
seems  small,  it  would  result  in  a separation  of  about  12  ft  when  flying  at  566  ft/s  for  30  sec.  The  track 
differences  over  the  whole  run  would  produce  a separation  of  about  9.3  ft  if  the  simulations  were  flying  at 
the  same  speed.  The  root  of  the  sum  of  the  squares  of  the  contributions  from  speed  and  track  differences 
is  approximately  equal  to  the  final  distance  between  the  two  simulations.  However,  differences  in  speed  and 
track  cannot  explain  the  separation  distance  between  SIM  2 and  the  other  simulations.  Differences  in  speed 
between  SIM  2 and  SIM  5 are  small  and  would  produce  an  estimated  separation  between  the  simulations 
of  only  0.5  ft.  Likewise,  differences  in  track  produce  a estimated  separation  of  only  4.7  ft  at  the  end  of  the 
run.  The  difference  charts  for  longitude  and  latitude  (Figure  31f)  both  show  that  the  geodetic  location  of 
SIM  2 departs  from  the  other  simulations  throughout  the  run.  In  fact,  when  the  lateral  offset  is  commanded 
at  t = 20  sec,  the  reported  geodetic  position  of  SIM  2 is  already  18.8  ft  apart  from  SIM  5 and  18.6  ft  away 
from  SIM  4.  Because  these  separations  are  not  consistent  with  differences  in  speed  or  track,  the  likely  cause 
is  a difference  in  the  methods  employed  to  derive  or  propagate  the  geodetic  position. 
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D.1.17  Check-case  15  — circumnavigation  of  the  North  Pole 

This  section  shows  cross-plots  for  two  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a subsonic 
aircraft  flying  in  a circle  around  the  North  Pole  of  a rotating,  ellipsoidal  (WGS-84)  Earth  with  Jn  gravitational 
harmonics.  This  scenario  is  described  in  Section  C.1.18.  Figures  33a  through  33x  compare  results  between 
the  two  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average 
value. 

Atmospheric  check-case  15  executed  a circumnavigation  of  the  North  Pole  as  directed  by  a slightly  more 
sophisticated  autopilot.  All  participating  simulation  tools  succeeded  in  establishing  a steady-state  circum- 
navigation of  the  pole;  however,  differences  in  both  the  initial  state  and  the  circumnavigation  steady  state 
values  were  observed. 

Figure  32a  shows  a top-down  view  of  the  trajectory  predicted  by  three  simulation  tools  for  this  check-case. 
In  the  180  sec  of  run-time,  the  three  vehicles  circumnavigate  more  than  three-quarters  of  the  way  around 
a circle  designed  to  have  a radius  of  3.0  nautical  miles.  Figure  32b  shows  a closer  detail  near  the  point 
where  SIM  2’s  slightly  larger  circumnavigation  ends,  showing  the  location  of  the  other  two  trajectories  inside 
SIM  2’s  circle. 

As  with  prior  F-16  test  cases,  the  simulations  began  with  differences  in  their  equilibrium  solutions  at  the  start 
of  the  scenario.  In  this  scenario,  all  simulated  trajectories  began  with  distinctly  different  angular  rates.  As 
before,  SIM  2 constrained  the  inertial  angular  rate  of  zero.  SIM  4 appeared  to  have  modified  its  equilibrium 
solution  to  target  an  angular  rate  of  zero  in  the  Earth-relative  frame,  while  SIM  5 solved  for  the  three-axis 
angular  rate  that  maintained  the  vehicle  orientation  relative  to  the  local  vertical  frame  as  the  simulated 
vehicle  flew  over  the  curved  surface  of  the  Earth. 

In  SIM  4,  the  zero  rotational  rate  relative  to  the  Earth  induced  no  aerodynamic  side  force,  rolling  moment, 
or  yawing  moment.  In  SIM  2,  a zero  inertial  rate  translated  into  an  Earth-relative  rate  where  much  of  the 
Earth’s  rotation  rate  appeared  in  body- axis  yaw  rate  rj,  with  a small  residual  in  body-axis  roll  rate  pb . The 
Earth-relative  rate  induced  an  aerodynamic  side  force,  rolling  moment,  and  yawing  moment  but  these  are 
small  enough  to  be  ignored:  the  induced  side  force  was  0.14  lbf.  On  the  other  hand,  SIM  5 initialized  the 
vehicle  at  an  Earth-relative  roll,  pitch,  and  yaw  rate  of  0.0828  deg/s,  —0.0015  deg/s,  and  1.7640  deg/s, 
respectively.  These  larger  rates,  especially  in  yaw,  may  seem  excessive;  however,  the  angular  momentum 
represented  by  these  rates  is  nearly  identical  to  the  angular  momentum  that  the  autopilot’s  control  inputs 
generated  for  the  circumnavigation  flight. 

The  main  difference  in  the  starting  and  ending  angular  rates  for  SIM  5 was  a result  of  the  roll  angle  that 
the  autopilot  commands  to  establish  the  circumnavigation  as  a coordinated  turn.  That  roll  angle  transfers 
some  of  the  angular  moment  from  the  yaw  rate  to  the  pitch  rate.  The  initial  roll  and  yaw  rates  for  SIM  5 
do  generate  substantial  lateral  forces  and  moments.  The  initial  aerodynamic  side  force,  rolling  moment, 
and  yawing  moment  are  —63  lbf,  —226  lbf-ft,  and  786  lbf- ft,  respectively.  The  SIM  5 equilibrium  solver 
forced  rudder  and  ailerons  to  have  zero  deflection.  Therefore,  these  rotation-induced  forces  and  moments 
were  not  counterbalanced  at  the  start  of  the  simulation.  Since  the  autopilot  was  engaged  at  the  start  of  the 
scenario  and  would  immediately  command  the  vehicle  into  circumnavigation  flight,  the  accelerations  that 
would  result  from  these  induced  forces  and  moments  were  quickly  counterbalanced.  Nevertheless,  this  led  to 
differences  in  lateral  forces  and  moments  at  the  start  of  the  run,  compared  to  SIM  2 and  SIM  4,  before  the 
autopilot  achieved  a steady-state  circumnavigation  configuration. 

SIM  2 runs  began  with  a non-zero  aerodynamic  side  force  and  aerodynamic  yawing  moment  that  were  larger 
than  what  would  be  induced  by  the  initial  non-zero  angular  rate  relative  to  the  Earth.  Moreover,  SIM  2 
began  with  a small  roll  angle  of  —0.083  degrees.  In  previous  cases,  these  differences  were  attributed  to  a 
gravity  vector  deflected  from  the  local  normal  as  a result  of  SIM  2 treating  the  geocentric  frame  as  the 
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(a)  View  from  above  North  Pole 


(b)  Detail  near  end  of  SIM  2 

Figure  32.  Trajectories  of  Simulated  F-16  Circling  the  North  Pole  for  Three  Simulation  Tools 


local  vertical.  In  the  previous  cases,  the  angle  of  deflection  of  SIM  2’s  gravity  vector  from  a vector  normal 
to  the  reference  ellipsoid  matched  the  difference  between  the  geocentric  and  geodetic  latitude.  However, 
the  geocentric  and  geodetic  frames  are  nearly  coincident  for  this  check-case,  as  the  scenario  is  performed 
close  to  the  North  Pole.  At  this  initial  location,  the  difference  between  the  geodetic  and  geocentric  “down” 
vector  was  only  0.00034  degrees.  This  is  much  smaller  than  the  initial  SIM  2 roll  angle  so  the  roll  angle 
was  not  being  driven  into  alignment  with  the  gravity  vector.  The  SIM  2 initial  state  showed  that  its  rate  of 
change  for  the  air-relative  velocity  (i.e. , ii,  v , and  w)  was  near  zero.  The  rate-of-change  for  the  air-relative 
velocity  contains  a term  that  is  the  cross  product  of  the  Earth-relative  angular  rate  and  the  air-relative 
velocity.  As  discussed  in  the  previous  check-case,  SIM  2 had  an  initial  Earth-relative  yaw  rate  equal  to 
the  Earth’s  rotation.  The  cross-product  term  would  have  contributed  a value  of  —0.0411  ft/s2  to  v.  When 
this  acceleration  was  combined  with  the  gravity  vector,  the  starting  acceleration  in  the  y-z  plane  that  the 
equilibrium  solver  had  to  counter  had  a deflection  of  —0.07  degrees.  This  deflection  is  in  the  neighborhood 
of  the  initial  SIM  2 roll  angle;  therefore,  the  initial  roll  angle  and  aerodynamic  side  force  are  driven  by  the 
angular-rate-induced  v.  The  initial  aerodynamic  yawing  moment  was  needed  to  counteract  the  moment  at 
the  CM  generated  by  the  initial  aerodynamic  side  force. 

SIM  4’s  trajectory  began  with  x and  z (body  axis)  accelerations  of  —1.98  ft/s2  and  —4.32  ft/s2,  respectively. 
SIM  4 also  had  an  initial  pitch  acceleration  of  —44  deg/s2  which  was  the  result  of  an  untrimmed  aerodynamic 
pitching  moment  of  —42,923  lbf-ft  at  the  CM.  The  non-zero  body  0-axis  acceleration  and  aerodynamic 
pitching  moment  at  the  CM  had  the  same  root  cause.  The  body  z-axis  acceleration  arose  from  a lift  vector 
that  was  larger  than  necessary  for  trim.  The  larger  lift  was  not  caused  by  a difference  in  dynamic  pressure  or 
angle  of  attack.  Both  values  were  nearly  identical  across  the  simulations.  The  cause  of  the  larger  lift  appeared 
to  be  untrimmed  elevator  deflection.  The  initial  elevator  for  SIM  4 was  set  at  +1.09  degrees  (trailing-edge 
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down).  By  comparison,  the  elevator  deflection  for  SIM  5 was  —3.26  degrees  (trailing-edge  up).  This  elevator 
deflection  also  resulted  in  a non-zero  pitching  moment  at  the  CM.  The  initial  elevator  deflection  for  SIM  4 
actually  increased  aerodynamic  pitching  moment  at  the  CM. 

The  non-zero  body  x-axis  acceleration  in  SIM  4 was  caused  by  insufficient  engine  thrust.  The  initial  thrust 
in  SIM  4 of  845  lbf  was  less  than  half  the  thrust  required  to  counter  balance  the  aerodynamic  drag  and  the 
component  of  weight  in  the  x axis  direction  (due  to  pitch  angle).  In  fact,  the  initial  power  level  angle  (PL A) 
of  6.32%  for  SIM  4 is  less  than  half  the  initial  PLA  of  13.86%  in  SIM  5.  It  is  unclear  why  SIM  4 failed  to 
reduce  these  accelerations  since  it  did  this  successfully  in  the  previous  F-16  cases,  but  it  did  not  appear  to 
have  been  trimmed  at  initialization.  The  autopilot  quickly  corrected  these  initial  accelerations  within  the 
first  tenth  of  a second.  Therefore,  the  untrimmed  initial  conditions  for  SIM  5’s  solution  did  not  contribute 
significantly  to  the  outcome  of  the  simulation. 

As  in  the  prior  F-16  cases,  SIM  2 recorded  aerodynamic  moments  at  the  MRC,  while  SIM  4 and  SIM  5 
recorded  aerodynamic  moments  at  the  vehicle  CM.  This  led  to  the  large  differences  shown  in  Figure  33d. 

As  with  the  prior  autopilot  check-cases  13.1  through  13.4,  a different  approach  was  taken  in  SIM  5 in  the 
modification  of  the  internal  reference  state  values  for  the  LQR  controller  for  angle  of  attack,  pitch  attitude, 
and  velocity  states  to  match  the  values  from  the  equilibrium  solution  for  the  initial  conditions,  which  led  to 
small  differences  in  the  steady-state  circumnavigation  conditions. 

As  in  the  prior  autopilot  check-cases,  SIM  4 and  SIM  5 ended  with  slightly  different  steady-state  airspeeds. 
In  this  scenario  the  difference  in  true  airspeed  was  0.13  ft/s.  The  minute  differences  in  final  latitude  and 
altitude  indicated  that  the  circumnavigation  path  for  the  two  simulated  trajectories  is  nearly  identical.  Thus 
the  small  difference  in  airspeed  was  the  likely  cause  of  small  differences  in  roll  angle  and  pitch  angle,  since 
velocity  determines  the  necessary  bank  angle  for  coordinated  flight  at  given  turn  radius  as  well  as  affecting  the 
angle  of  attack  necessary  to  maintain  level  flight.  The  difference  in  velocity  was  also  the  dominant  contributor 
to  the  difference  in  longitude  between  the  two  simulations.  The  longitude  difference  of  0.0639  degrees  after 
180  sec  represented  a distance  of  21  ft  which  was  close  to  the  distance  of  23  ft  that  would  occur  with  a 
0.13  ft/s  difference  in  airspeed  for  180  sec. 

SIM  2 followed  a slightly  larger  circumnavigation  radius  than  SIM  4 or  SIM  5 (approximately  2.368  ft  farther 
south)  as  shown  in  Figure  32b.  However,  such  a small  increase  in  circumnavigation  radius  was  contradicted 
by  the  differences  in  longitude  and  roll  angle,  both  of  which  should  primarily  depend  on  the  differences 
in  airspeed  and  circumnavigation  radius.  The  airspeed  difference  between  SIM  2 and  SIM  5 was  0.02  ft/s 
and  should  have  produced  a lead  for  SIM  2 of  4 ft  after  t = 180  sec  if  the  circumnavigation  radii  were 
equal.  However,  the  larger  radius  circle  flown  by  SIM  2 should  have  caused  it  to  lag  behind  SIM  4 and  5 in 
longitude,  despite  having  a slightly  faster  airspeed.  The  longitudinal  difference  at  t = 180  sec  should  have 
been  in  the  neighborhood  of  —0.03  degrees;  thus  SIM  2’s  simulated  trajectory  should  have  trailed  behind 
those  of  SIM  4 and  5,  ending  with  a distance  of  about  9 ft  to  the  west.  However,  SIM  2 showed  a lead  in 
longitude  of  0.93  degrees  (300  ft  east)  at  t = 180  sec.  With  identical  airspeeds,  this  further  distance  flown  in 
SIM  2’s  solution  implied  SIM  2’s  circumnavigation  radius  would  need  to  be  approximately  57  ft  shorter.  A 
steeper  steady-state  roll  angle  given  by  SIM  2’s  solution  of  0.135  degrees  also  suggested  a shorter  navigation 
radius.  To  a first-order  approximation,  this  increase  would  imply  a reduction  in  circumnavigation  radius  of 
about  100  ft. 

Assuming  integrations  were  performed  in  inertial  coordinates  by  all  simulations  and  then  positions  were 
transferred  to  geodetic  coordinates,  it  appears  that  there  may  be  some  difference  between  the  simulation 
tools  in  the  conversion  from  geodetic  coordinates  to  geocentric  coordinates  that  shortened  the  distance  to 
the  pole  for  a given  geodetic  latitude. 
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D.1.18  Check-case  16  — circular  flight  around  the  equator-IDL  intersection 

This  section  shows  cross-plots  for  three  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a subsonic 
aircraft  flying  in  a circle  around  the  intersection  of  the  Equator  and  ±180  deg  longitude  of  the  ellipsoidal 
Earth.  This  scenario  is  described  in  Section  C.1.19.  Figures  35a  through  35x  compare  results  between  the 
three  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average 
value. 

Atmospheric  check-case  16  was  similar  to  check-case  15  but  instead  of  flying  around  the  North  Pole,  it 
executed  a circumnavigation  about  the  intersection  of  the  Equator  and  the  International  Date  Line.  This 
circumnavigation  was  controlled  by  the  circumnavigating  autopilot.  All  simulations  do  succeeded  in  es- 
tablishing a steady-state  circumnavigation;  however,  differences  in  initial  state  and  the  circumnavigation 
steady-state  are  noted. 

The  resulting  trajectories  from  the  three  participating  simulation  tools  are  shown  in  Figure  34a.  It  shows 
that  SIM  2 starts  slightly  inside  the  other  two  simulations,  but  finished  slightly  earlier  and  outside  the  path 
of  the  other  two  simulations. 


Longitude,  deg  (+EAST) 


(a)  Overview 


(b)  Detail  near  start 


(c)  Detail  near  end 


Figure  34.  Trajectories  of  Simulated  F-16  Circling  the  Equator/IDL  for  Three  Simulation  Tools 


A number  of  differences  identified  in  previous  F-16  check-cases  persisted  in  this  check-case: 

• The  simulations  targeted  different  initial  angular  rates  for  straight  and  level  flight.  SIM  2 constrained 
the  initial  angular  rate  to  be  zero  in  the  inertial  frame.  SIM  4 achieved  an  initial  angular  rate  that 
was  zero  in  the  Earth-relative  frame.  SIM  5 targeted  the  three-axis  Earth-relative  angular  rate  that 
maintained  the  vehicle  orientation  as  it  traveled  over  the  surface  of  the  Earth.  In  this  scenario,  the 
resulting  angular  rate  was  zero  in  roll  and  yaw  and  was  —0.00155  deg/s  in  pitch.  Thus,  it  was  most 
similar  to  the  initial  angular  rate  for  SIM  4.  Because  the  autopilot  immediately  caused  a change  in 
angular  rates  as  it  established  circumnavigation,  these  differences  did  not  have  a significant  impact  on 
the  steady  state  results. 

• To  some  degree,  the  steady-state  outcome  under  the  autopilot  was  a balance  achieved  between  the 
autopilot  algorithm  and  the  LQR  stability  algorithm.  The  LQR  stability  algorithm  operated  on  per- 
turbations of  state  variables  (angle  of  attack,  pitch  rate,  velocity  and  pitch  attitude)  from  predetermined 
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reference  values,  resulting  in  delta  commands  to  corresponding  trimmed  values  for  throttle  and  longi- 
tudinal stick.  These  internal  referenced  state  values  differed  slightly  from  the  trim  values  calculated  by 
each  simulation  tool.  All  simulation  tools  were  expected  to  replace  the  LQR  trimmed  values  for  throttle 
and  longitudinal  stick.  SIM  2 and  SIM  5 should  have  agreed  on  the  LQR  trim  values  for  throttle  and 
longitudinal  stick  based  on  similarities  in  other  states.  However,  SIM  4 established  initial  throttle  and 
longitudinal  stick  settings  that  differed  substantially  from  SIM  2 and  SIM  5.  As  explained  below,  those 
settings  failed  to  reduce  accelerations  in  the  body  x-z  plane  to  zero.  Additionally,  SIM  5 replaced  the 
LQR  referenced  state  values  for  angle  of  attack,  pitch  angle,  and  airspeed  (trimmed  reference  pitch  rate 
was  zero).  The  default  trim  values  were  about  a degree  higher  for  angle  of  attack  and  pitch  angle  and 
were  about  0.8  kt  higher  for  airspeed  than  the  provided  values  in  the  F-16  autopilot  DAVE-ML  file. 
The  difference  between  the  default  LQR  trim  values  and  the  autopilot  speed  command  was  previously 
been  identified  as  a possible  source  for  the  steady-state  speed  difference  between  SIM  4 and  SIM  5. 
That  trend  continued  here:  the  difference  in  steady-state  speed  between  the  two  simulation  tools  was 
—0.13  ft/s  and  was  established  within  the  first  second  of  the  simulated  maneuver.  The  steady-state 
speed  difference  between  SIM  2 and  SIM  5 was  much  smaller  at  0.019  ft/s. 

• SIM  4 did  not  begin  the  simulation  in  an  equilibrium  state  for  straight-and- level  flight.  Large  acceler- 
ations remained  in  the  body  x-  and  z-axes  and  in  pitch  acceleration.  The  initial  elevator  deflection  of 
—0.69  degrees  did  not  generate  sufficient  aerodynamic  pitching  moment  to  counterbalance  the  pitching 
moment  generated  by  the  lift  at  the  CM.  The  elevator  deflection  also  did  not  reduce  lift  enough  to 
counterbalance  weight  and  left  a net  upward  acceleration.  The  initial  throttle  setting  did  not  generate 
enough  thrust  to  counterbalance  drag  and  the  component  of  weight  in  the  body  x-axis  due  to  the  pitch 
angle. 

• As  before,  SIM  2 recorded  the  aerodynamic  moments  at  the  MRC.  SIM  4 and  SIM  5 recorded  aero- 
dynamic moments  at  the  vehicle  CM.  As  a result,  SIM  2 recorded  non-zero  aerodynamic  pitching  and 
yawing  moments  when  the  simulations  achieve  steady-state  navigation. 

In  this  scenario,  it  was  more  difficult  to  identify  small  differences  in  the  steady-state  circumnavigation  radius 
among  the  simulations.  Both  latitude  and  longitude  changed  so  the  radius  had  to  be  estimated  from  both 
using  the  radii  of  curvature.  The  estimates  used  the  last  100  sec  of  data  in  which  all  three  simulations 
appeared  to  have  achieved  steady-state  flight.  The  estimated  radii  indicate  that  the  circumnavigation  path 
was  a slightly  flattened  circle  for  all  simulations.  For  SIM  2,  the  circle  had  a major  axis  of  18,758  ft  and 
a minor  axis  of  18,703  ft;  the  resultant  flattening  parameter  was  0.0029.  For  SIM  4 and  SIM  5,  the  circle 
had  a major  axis  of  about  18,721  ft  and  a minor  axis  of  18,685  ft;  the  resultant  flattening  parameter  was 
0.0019.  The  perimeters  of  the  circles  similarly  differ.  The  circle  for  SIM  5 had  a perimeter  of  117,517.6  ft. 
The  perimeter  for  SIM  2 differed  from  that  of  SIM  5 by  +169  ft  and  the  estimated  perimeter  for  the  SIM  4 
circle  differed  by  —3.23  ft.  Due  to  its  larger  perimeter  and  near-equal  speed,  SIM  2 would  be  expected  to 
lag  SIM  5.  Similarly,  because  of  the  near-equal  perimeter  but  slower  airspeed,  SIM  4 would  be  expected  to 
lag  SIM  5.  These  expectations  were  confirmed  by  differencing  the  world-relative  positions  and  taking  the 
magnitude  of  the  difference.  Using  this  method,  SIM  4 lagged  SIM  5 by  16.8  ft  and  SIM  2 lagged  SIM  5 by 
320  ft. 

The  roll  angle  for  each  simulation  varied  with  the  circumnavigation  radius;  therefore,  it  fluctuated  as  the 
circumnavigation  radius  fluctuated.  Even  so,  the  average  roll  angle  differed  very  little  among  the  simulations 
and  those  differences  could  be  predicted  from  the  differences  in  the  average  circumnavigation  radius  and 
airspeed.  The  average  roll  angle  for  SIM  2 differed  from  SIM  5 by  0.0285  degrees  and  the  SIM  4 roll  angle 
differed  from  SIM  5 by  0.0122  degrees.  Similarly,  the  average  pitch  angle  differed  among  the  simulations 
by  less  than  0.013  degrees.  The  yaw  angle  differed  in  accordance  with  the  respective  leading  or  lagging  of 
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position  of  the  simulated  vehicles  along  the  circumnavigation  circle  relative  to  the  other  simulation  tools’ 
predictions.  At  the  end  of  the  simulation,  SIM  4 and  SIM  5 differed  in  yaw  angle  by  0.05  degrees;  SIM  2 
and  SIM  5 differ  by  0.77  degrees.  These  values  imply  that  SIM  4 lagged  SIM  5 by  around  16.6  ft  and  SIM  2 
lagged  SIM  5 by  251  ft,  which  are  similar  to  the  separations  obtained  by  differencing  the  world-relative 
position  vectors. 

One  unexplained  result  in  this  scenario  was  that  SIM  4 quickly  generated  a large  aerodynamic  rolling  moment 
of  about  32,000  lbf-ft  for  about  5 sec.  Then  the  moment  went  to  zero.  Then  it  returned  to  about  26,000  lbf-ft 
starting  at  36.8  sec  and  for  the  remainder  of  the  run.  The  roll  acceleration  (p)  responded  to  this  aerodynamic 
rolling  moment;  however,  the  body-axis  roll  rate  p did  not  react  as  if  the  vehicle  were  undergoing  the  recorded 
roll  acceleration.  The  change  of  p from  frame-to-frame  is  much  smaller  and  often  in  the  opposite  direction 
to  the  recorded  p. 
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D.1.19  Check-case  17  — flight  of  two-stage  launch  vehicle 

This  section  shows  cross-plots  for  three  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  an 
unguided  two-stage  rocket  launched  into  a highly  elliptical  orbit.  This  scenario  is  described  in  Section  C.1.20. 
Figures  36a  through  36x  compare  results  between  the  three  simulation  tools,  as  well  as  the  deviances  of  the 
outputs  from  each  tool  from  the  ensemble  average  value. 

This  scenario  simulated  the  ascent  of  a two-stage  rocket.  The  translational  and  rotational  dynamics  were 
coupled  in  this  check-case  and  the  results  were  very  sensitive  to  differences  in  the  rotational  dynamics  since 
the  attitude  of  the  vehicle  determined  the  direction  of  the  thrust  vector.  The  results  were  also  sensitive 
to  the  exact  timing  of  first-stage  engine  cutoff,  first-stage  jettison,  second-stage  ignition,  and  second-stage 
engine  cutoff. 

There  were  two  main  causes  of  the  simulation  differences  in  this  scenario:  First,  the  simulations  differed  on 
modeling  the  engine  cutoff  times.  SIM  4 included  the  capability  of  modeling  discrete  events:  it  determined 
and  modeled  the  exact  moment  of  first-stage  engine  cutoff  and  second-stage  engine  firing.  Moreover,  the 
interstage  coast  time  was  specified  to  last  a fixed  amount  of  time  from  the  exact  moment  of  first-stage  engine 
cutoff.  However,  SIM  5 and  SIM  6 were  both  fixed-step  simulations  that  did  not  model  discrete  events 
precisely.  Thus,  SIM  4 modeled  first  stage  engine  cutoff,  second-stage  engine  ignition,  and  second-stage 
engine  cutoff  to  occur  at  times  that  fell  between  the  fixed  time  steps  used  by  the  other  simulations.  When 
SIM  5 was  re-run  with  a faster  frame  rate,  it  better  approximated  the  results  of  SIM  4 with  the  position 
differences  at  t = 200  sec  showing  a position  difference  of  2.4  ft  (with  a frame  rate  of  10,000  frames/s). 
Higher  frame  rates  failed  to  improve  results  due  to  differences  in  integration  error,  the  increasing  magnitude  of 
cumulative  round-off  error,  and  the  cumulative  effect  of  otherwise  minute  differences  between  the  simulations. 
The  SIM  5 results  presented  here  were  run  at  1,000  frames/s  and  showed  a position  difference  of  21.6  ft  from 
SIM  4 at  t = 200  sec. 

The  second  cause  of  differences  was  a difference  in  modeling  the  change  in  the  moments  of  inertia  with 
fuel  burn.  The  mass  properties  models  in  SIM  4 and  SIM  5 were  configured  to  execute  or  closely  match 
a linear  change  in  the  moments  of  inertia  with  propellant  burn.  SIM  4 and  SIM  5 agreed  on  moments  of 
inertia  to  within  1 slug-ft2.  SIM  6,  on  the  other  hand,  had  a higher- fidelity  mass  properties  model  that 
could  not  easily  be  reconfigured  to  model  a simple  linear  change  in  moments  of  inertia  with  fuel  burn  (but 
did  provide  a close  approximation).  Nevertheless,  SIM  6 differed  from  SIM  4/5  in  its  moments  of  inertia  by 
up  to  1,400  slug-ft2.  This  changed  the  rotational  response  of  the  vehicle  enough  that,  at  first-stage  engine 
cutoff,  the  predicted  attitude  in  SIM  6 differed  from  SIM  4/5  in  pitch  by  0.12  degrees  and  in  pitch  rate  by 
0.13  deg/s.  As  mentioned  previously,  attitude  differences  coupled  strongly  into  subsequent  thrust-induced 
linear  acceleration,  velocity  and  position  differences,  and  since  the  vehicle  model  had  no  guidance  or  attitude 
control,  small  angular  rate  differences  would  integrate  to  become  significant  attitude  differences. 

The  SIM  6 solution  exhibited  enough  of  difference  in  thrust  vector  pointing  direction  relative  to  SIM  4/5 
that  vehicle  CM  position  differed  by  46  ft  at  first-stage  engine  cutoff,  and  the  direction  of  the  velocity  vector 
differed  by  0.043  degrees.  During  the  coast  phase,  the  difference  in  pitch  rate  at  engine  cutoff  between  SIM  6 
and  SIM  4/5  was  enough  to  increase  the  difference  in  pitch  angle  to  4 degrees  when  the  second-stage  engine 
fired.  This  essentially  placed  the  rocket  in  SIM  6 on  a different  trajectory  than  the  rocket  in  SIM  4/5  for 
the  second-stage  ignition.  This  is  why  the  position  difference  increased  to  61,000  ft  (10  NM)  by  the  end  of 
the  scenario. 


NESC  Document  No.:  NESC-RP-12-00770,  Volume  II 


NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

340  of  609 

I : I 


i : + 


222 

TTT 


£ 
! H 


g 

! H 


3§BJ3Ay  - X jqj  90JOJO.I3B 


222 

i : I 


OO'O'l'MOM't'OOO 
OOOOOOOOO 
o o o p p p p p p 

o’  o’  o’  o’  o’  o’  o’  o’  o' 


3§BJ3Ay  - y jqj  3D.I0j0.I3B 


222 


I : I 


£ 
; h 


g 

; h 


£ 
I h 


3§BJ3Ay  - 2 jq[  33i0j0J3B 


222 

I Ik 


oo'CTfrjocs^'Ooo 
OOOOOOOOO 
p p p p p p p p p 

o’  o"  o'  o’  o’  o'  o’  o’  o' 


£ 
I H 


o 

d 

CD 

%-i 

p<D 

5 


cS 


p 

d*. 

O 

Sh 

CD 

C 


CD 

Sh 

d 

CD 


O 

O 


£ 


d 

d 

>> 

dD 

o 

Sh 

CD 

C 


d 

.2 

o 

CD 

cn 


d 

o 


d 

cd 


CD 

CD 

cn 

oT 

Id 

3 

S> 

rd 

CD 

3 

c6 

hd 

CD 

bjO 

c6 


O 

£ 

H 


rd 

bX) 


d 

CD 

rd 

o 

CD 

rd 

O 


co 

CO 


d 

tuO 


X jqi  30JO jXpoq  ojsb 


y jqj  sojo  jApoq  ojsb 


Z jq[  sdjo  jApoq  ojsb 


NESC  Document  No.:  NESC-RP- 12-00770,  Volume  II 


NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

341  of  609 

I : I 


i : + 


lit 


£ 
! h 


Cfl'C^tMON^'OCOO 
OOOOOOOOO^* 
o o p p p p p p p p 

o’  o'  o’  o o'  o’  o’  o’  o o’ 


3§ej3Ay  - q jqpj  juauiop^ojsp 


g 
! H 


£ 
! H 


M'O^NON^-'OOO 

ooooooooo 

p p p p p p p p p 

o’  o o’  o’  o o’  o’  o o’ 


3§BJ9Ay  - j/\[  jqm  ju3uiop\[OJ3B  sSmaAy  - tq  jqpj  iusuioj^ojsp 


i : + 


222 

I : \ 


222 

i?? 


£ 
! H 


g 
! H 


£ 
! H 


o 

£ 

0) 

Jh 

,03 


O 

s 


c6 

>5 

to 

O 

Sh 

0) 

< 


Oh 

a 

o 

o 


o 

s 


d 

rt 

to 

O 

Sh 

0) 


a 

o 

O 


.2 

to 

o 

03 


o 


0 

o 


03 

03 

m 

oT 

T3 

2 

£ 

03 

0 

0 

c5 

to 

03 

tuO 

c5 


O 

£ 

to 


to 

tuO 


o3 

03 

to 

03 

03 

to 

U 

to 

co 


3 

bjo 


oooooooooo 


ooooooooo 


q jqjy  juauiopjApoq  ojse 


IAI  jqm  jU3Uiop\[Apoq  oise 


N jqpj  iu3uioj/\lApoq  o.iap 


NESC  Document  No.:  NESC-RP- 12-00770,  Volume  II 


© 

NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

342  of  609 

9§BJ3Ay  - y [Sp\[J|B 


auijasug  - Sap  Suoj 


auxpsBg  - Sap  jbj 


y Isp^aprqiyB 


Sap  apnySuoj 


Sap  apnyjBj 


op 

0 

op 

Jh 

pop 

to 


to 

3 

•+J 

‘So 

0 

o 

to 

to 

£ 

o3 

OP 

to 

0 


o3 

to 


OP 

to 

o 

o> 

O 


to 

0 


< 


d 

to 

a 

O 

O 

OP 

to 

0 

■+J 

‘So 

0 

o 

to 

to 

£ 

o3 

OP 

to 

0 


c3 

to 


to 

O 

03 

o 

op" 

to 

2 


< 


to 


03 


.2 

to 

op 

OP 

m 


£ 

o 


0 

03 


OP 

03 

m 


rto 

£ 

r0 

OP 

0 

0 

0 

to 

OP 

bjO 

0 


O 

£ 

to 


to 

bjO 


0 

OP 

to 

03 

OP 

to 

O 


to 

co 

OP 

Sh 

0 

bp 

to 


NESC  Document  No.:  NESC-RP- 12-00770,  Volume  II 


% 

NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

343  of  609 

srnpseg  - Sap  avea 


suxpsBg  - Sap  ipjig 


auipseg  - Sap  jjcyg 


111 


111 


111 


to 

o 

o 

d 

o> 

S-i 

pa> 

to 


to 

P 

to 


cC 

fl 

< 


d 

to 


d 

to 

a 

O 

U 


to 

Q 

to 

£ 


'c-C 

d 


d 

to 


to 


05 


d 

.2 

to 

CJ> 

<D 

cn 


d 

o 


d 

o 


0) 

CD 

m 


to 

£ 

to 

CD 

d 

d 

d 

to 

CD 

tuO 

d 


O 

£ 

to 


rd 

bjo 


d 

CD 

to 

CD 

CD 

to 

O 


CD 

CO 

CD 

Sh 

d 

#bf) 

to 


NESC  Document  No.:  NESC-RP- 12-00770,  Volume  II 


© 

NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

344  of  609 

£S  y XjIABJ9lBOO| 


UTU.I  y 


s y puno§joP33^s 


NESC  Document  No.:  NESC-RP- 12-00770,  Volume  II 


© 

NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

345  of  609 

NESC  Document  No.:  NESC-RP-12-00770,  Volume  II 


© 

NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

346  of  609 

x S }J  XjpopASJ 


A s « XjpopASj 


Z s « ^P°PA3J 


x) 

o 


to 


o 

0 

1 

Q 

H 

2; 


to 

<d 

s-< 

c6 

Dh 


O 

O 


£ 

Q 

to 

£ 


to 


05 


.2 

to 

cd 

CD 

co 


a 

o 


o 

cd 


0) 

CD 

m 


to 

£ 

to 

CD 

3 

o3 

to 

CD 

tuO 

c5 


O 

£ 

to 


to 

bjO 


c5 

CD 

to 

CD 

CD 

to 

U 


CD 

CO 

0) 

fH 

2 

bp 

to 


NESC  Document  No.:  NESC-RP- 12-00770,  Volume  II 


© 

NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

347  of  609 

sss 

I : I 


sss 

I : t 


sss 

I il 


g 

H 


s 

h 


E 
; h 


M'C^'OION^'OOO 

ooooooooo 
poppppppp 
o o’  o’  o’  o’  o"  o’  o o’ 


3§RI3AV  - X s ¥ PAP 


9§m3Ay  - A s 1J  PAP 


3§BJ3Ay  - z s y PAP 


X s y XjpopAP 


A s y XyoopAP 


Z s y ^apopAP 


to 

Q 

CD 


P<D 


£ 


d 

a 

a 

o 

O 


o 

0 

1 


to 


05 


0 

.2 

to 

cd 

CD 

m 


0 

o 


0 

CD 


0) 

CD 

m 


to 

£ 

r0 

CD 

0 

o5 

to 

CD 

tuO 

0 


O 

£ 

to 


to 

bjO 


0 

CD 

to 

CD 

CD 

to 

U 


to 

co 

0 

?H 

2 

#bp 

to 


NESC  Document  No.:  NESC-RP- 12-00770,  Volume  II 


NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

348  of  609 

3§E.i3Ay  - pog  s Sap  tgaiegSuB  aSeiaAy  - qopj  s Sap  igaie^Sire  aSmaAy  - mb^  s Sap  igajegSuE 


pog  s Sap  igyywajBgjBinSuyXpQq  qajig  s Sap  igiJ^ajB^.iB|nSuyXpoq  ayba  s Sap  igjjy^aiB^jJBpiSuyApoq 


to 

<D 


to 

5 


to 

P 

to 

£ 


to 


P 

cC 

d 

< 


>5 

to 

O 

to 


d 

to 

a 

o 

U 


Q 

to 

£ 


d 

to 


p 

bO 

d 


d 

>. 

to 

o 

to 


to 


05 


d 

.2 

to 

CJ> 

P 

m 


d 

o 


d 

o 


<p 

<p 

cn 


to 

£ 

to 

<p 

d 

d 

d 

to 

a> 

tuO 

d 


O 

£ 

to 


to 

bjO 


d 

o 

to 

<p 

tp 

to 

O 


to 

co 

a> 

f-H 

d 

#bf) 

to 


NESC  Document  No.:  NESC-RP- 12-00770,  Volume  II 


© 

NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

349  of  609 

9§Ei3Ay  - £JJ  §tl[S  Ajisusqjib 


3§BJ3Ay  - m jq[  sinssajj 


3§Ri3Ay  - ^j§p  diusxJuaiqLUB 


to 

CD 

CD 

3 


pop 

to 


<P 

Oh 

o 

5h 


Oh 


< 


to 

OP 

S-H 

C$ 

a 

S 

o 

O 


a 

o 


<< 


to 


05 


0 

.2 

to 

cd 

OP 


a 

o 


O 

o 


OP 

CD 

m 


to 

£ 

to 

CD 

o 

3 

o3 

to 

OP 

bjO 

c5 


O 

£ 

to 


to 

bjO 


a3 

CD 

to 

CD 

OP 

to 

O 


to 

co 

OP 

f-H 

o 

bp 

to 


NESC  Document  No.:  NESC-RP- 12-00770,  Volume  II 


% 

NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

350  of  609 

o 


22 
c/5  c/5 

a 


C/5  C /5 


22 
C/5  C/5 


g 

! h 


3§BJ3Ay  - x y uoijisojaS 


22 
C/5  C/5 

A 


9§BJ3Ay  “Ay  UOTJTSOJSS 


22 
1/5  C/5 

it 


E 

h 


E 
; h 


OO'O^NOM't'OOO 

ooooooooo 
poppppppp 
o o o’  o’  o’  o’  o’  o o’ 


3§BJ3Ay  - z 1J  uoijisojsS 


22 
C/5  C/5 


E 
; h 


OOOOOOOOO 


tg 

S 

72 

a 

.2 

*02 

O 

dn 

£ 

A 


P 

bO 

fl 

d 


0) 

X 

ca 


d 

W 

a> 


d 

w 


d 

a 

2 

o 

U 

72 

o 


o 

Ph 


d 

bC 

rt 

d 


a; 


X 

cd 


d 

w 

02 

Sh 

V 

d 

02 

02 


d 

o 

O 


d 

.2 

*+^ 

02 

02 

m 


d 

o 


d 

02 


02 

02 

m 

oT 

13 

23 

£ 

rd 

02 

d 

d 

d 

hd 

02 

tuO 

d 


O 

£ 

Eh 


rd 

bJO 


d 

02 

02 

02 

pd 

U 

co 

CO 


d 

bJO 


X 1J  uoijisojsS 


A y U0IJIS0J3§ 


Z U uoijisojsS 


d 

w 


NESC  Document  No.:  NESC-RP- 12-00770,  Volume  II 


NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

351  of  609 

o 


NESC  Document  No.:  NESC-RP- 12-00770,  Volume  II 


% 

NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

352  of  609 

D.2  Scenario  comparisons  — Orbital 

D.2.1  Check  -case  02  — ISS  in  spherical  gravity 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  the 
ISS  in  orbit,  propagating  with  spherical  gravity  model  and  no  disturbances.  This  scenario  is  described  in 
Section  C.2.1.  Figures  37a  through  37p  compare  results  between  the  four  simulation  tools,  as  well  as  the 
deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

This  check-case  simulated  an  orbit  where  the  Earth’s  gravitation  is  the  only  force  acting  on  the  vehicle.  The 
Earth’s  gravitation  is  modeled  using  the  assumption  of  a spherically  symmetric  mass.  Thus,  the  Earth’s 
gravitation  is  not  dependent  on  Earth- relative  position  (aside  from  distance  from  the  center  of  the  Earth). 
This  allowed  independent  comparison  of  the  Earth-relative  values  reported  by  the  simulations  before  applying 
gravitation  and  atmospheric  models  that  are  functions  of  the  Earth-relative  position. 

The  simulations  agreed  on  inertial  positions  and  inertial  velocities.  Differences  plotted  for  velocity  and 
position  were  likely  due  to  varied  integration  methods  and  are  negligible.  Differences  plotted  for  acceleration 
reflected  the  influence  of  position  differences  on  the  computed  gravitation. 

Since  the  simulations  matched  so  closely  in  inertial  coordinates,  differences  in  Earth-fixed  variables  were  due 
to  differences  in  modeling  the  Earth.  In  propagated  ECEF  position,  SIM  B,  C,  and  D agreed  on  the  initial 
Earth-relative  position  vector.  SIM  A differed  by  a distance  of  less  than  0.3  m;  the  difference  vector  was 
{-0.022,  -0.231,  0.181}  m.  The  SIM  A position  difference  increased  slightly  reaching  a maximum  distance  of 
1 m and  a vector  difference  of  {-0.842,  -0.413,  0.429}  m.  SIM  B and  SIM  C remained  in  good  agreement 
throughout  the  run.  SIM  D departed  slightly  from  SIM  B/C,  reaching  a maximum  distance  of  0.28  m where 
the  vector  difference  was  {-0.153,  0.103,  0.211}  nr.  The  differences  in  the  position  for  SIM  A arose  from  a 
difference  in  the  international  terrestrial  reference  frame  (ITRF)  realization  used  by  the  simulations.  SIM  A 
used  ITRF93  (reference  [29]).  SIM  B,  C,  and  D use  ITRF89  [30].  These  models  differed  only  in  the  definition 
of  the  reference  figure  of  the  Earth  at  epoch  J2000;  the  methods  for  computing  the  change  in  RNP  of  the 
Earth  at  a given  time  were  the  same.  Thus,  the  two  ITRF  realizations  differed  only  by  a constant  rotation. 
SIM  D began  to  depart  from  SIM  B and  C because  SIM  D used  the  RNP  model  to  initialize  the  orientation 
of  the  Earth  but  assumed  a constant  Z- axis  rotation  afterward.  SIM  B and  SIM  C ran  the  full  RNP  model 
every  frame. 

On  the  altitude  chart,  the  differences  plot  (Figure  37d)  also  segregated  SIM  A from  the  SIM  B/C/D  cluster. 
The  differences  were  consistent  given  the  ECEF  differences.  The  difference  in  initial  altitude  was  4 parts 
per  million  whereas  the  difference  in  initial  Earth  position  was  11  parts  per  million.  There  might  also  have 
been  a minute  difference  in  the  accuracy  of  the  method  that  SIM  A used  convert  the  Earth-relative  position 
vector  to  altitude. 

The  difference  plots  for  angular  rate  (Figure  37f)  showed  some  small  disparity  between  SIM  A and  the 
SIM  B/C/D  cluster.  However,  these  differences  were  negligible  and  are  likely  caused  by  a difference  in  inte- 
gration method.  The  differences  in  angular  rate  also  contributed  to  the  larger  but  still  negligible  differences 
in  orientation  (inertial  and  LVLH  Euler  angles).  The  difference  in  orientation  was  likely  caused  by  both  by 
the  growing  difference  in  angular  rate  and  by  a difference  in  integration  method  employed. 

The  simulations  also  showed  differences  in  atmospheric  properties  (Figure  37d).  These  differences  are  ex- 
plained in  the  discussion  for  orbital  case  5 A (see  the  discussion  in  Section  D.2. 5). 
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D.2.2  Check-case  03A  — ISS  in  4 x 4 harmonic  gravity 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  the  ISS  in 
orbit  with  a 4 x 4 harmonic  gravity  model  and  no  disturbances.  This  scenario  is  described  in  Section  C.2.2. 
Figures  38a  through  38p  compare  results  between  the  four  simulation  tools,  as  well  as  the  deviances  of  the 
outputs  from  each  tool  from  the  ensemble  average  value. 

This  check-case  modified  orbital  case  2 by  replacing  the  gravitation  model  with  a spherical  harmonic  geopo- 
tential model  of  degree  four  and  order  four.  Gravitational  attraction  predicted  by  this  model  is  a function 
of  the  geocentric  position  of  the  vehicle;  therefore,  differences  in  the  Earth-relative  position  of  the  vehicle 
could  produce  small  differences  in  the  resultant  gravitation  vector.  Orbital  case  2 (section  D.2.1)  showed 
that  differences  in  the  modeling  of  the  Earth  RNP  produced  Earth-relative  position  differences  among  the 
simulations  no  greater  than  1 m.  Through  their  influence  on  the  gravitation  calculation,  the  Earth-relative 
position  differences  were  expected  to  contribute  to  differences  in  inertial  position.  However,  the  difference 
plot  for  inertial  position  (Figure  38n)  hints  that  differences  in  the  gravitation  model  implementation  were  the 
dominant  contributor  to  position  differences.  For  example,  SIM  B and  SIM  C had  the  closest  agreement  on 
inertial  and  Earth-relative  position  in  orbital  case  2,  yet,  here  they  departed  in  inertial  position  by  1.77  m. 
On  the  other  hand,  SIM  B and  SIM  D differed  in  inertial  position  by  no  more  than  0.2  m even  though,  in 
orbital  case  2,  their  Earth-relative  position  differed  by  up  to  0.28  m. 

Thus,  more  scrutiny  was  applied  to  the  gravitation  results.  At  the  scenario  start,  SIM  B,  SIM  C,  and 
SIM  D agreed  on  the  Earth-relative  position  to  within  a millimeter.  However,  the  SIM  C gravitation  vector 
differed  in  magnitude  from  the  other  two  simulations  by  5 x 10-8  m/s2.  While  a small  value,  it  was  of  the 
same  order,  or  larger  than,  some  of  the  terms  in  the  spherical  harmonic  gravitation  model.  To  objectively 
evaluate  the  gravitation  results  from  each  of  the  models,  an  independent  model  of  the  GEM-T1  spherical 
harmonic  gravitation  model  was  scripted  in  Mathcmatica® . The  initial  Earth-relative  position  reported  by 
each  simulation  was  fed  into  the  calculation  script,  and  the  resultant  gravitation  vector  was  compared  against 
the  gravitation  vector  reported  by  the  simulation.  Table  76  shows  the  difference  between  the  gravitation 
vector  reported  by  the  simulation  and  the  results  of  the  calculation  script. 


Table  76.  Comparison  of  Simulation  Gravitation  Vectors  to  Calculation  Script  at  t = 0 sec 


Simulation 

Geocentric  Gravitation  Error,  m/s2 

Error 

Magnitude 

Tool 

Up 

North 

East 

Norm,  m/s2 

Error,  m/s2 

SIM  A 

— 2.73xlO~07 

SIM  B 

2.66xl0"14 

— 4.56xl0-15 

— 1.17x  10-14 

— 1.60x  10”14 

-1.60xl0~14 

SIM  C 

— 5.25xlO-08 

— 5.44xlO-09 

— 5.14x  10-09 

5.25x  10~°8 

5.25xlO~08 

SIM  D 

2.56xl0"n 

— 8.56xl0-12 

1.36x  10~12 

— 2.62xl0~n 

— 2.62xl0~n 

In  the  table,  the  “error  norm”  is  the  magnitude  of  the  error  vector  and  the  “magnitude  error”  is  the  difference 
in  the  magnitude  of  the  simulation  gravitation  vector  compared  to  the  calculation  script  output.  In  each  case, 
the  geocentric  gravitation  vector  for  the  simulation  was  computed  using  the  inertial  gravitation  vector,  the 
RNP  matrix  (for  inertial  to  ECEF  transformation),  and  the  ECEF  position  vector  (to  compute  geocentric 
latitude  and  longitude  for  the  ECEF-to-geocentric  transformation).  The  ability  to  accurately  reconstruct  the 
geocentric  gravitation  vector  was  limited  by  the  precision  of  these  fields  in  the  recorded  data  set.  Also,  it  was 
assumed  that  no  field  leads  or  lags  the  others  by  a frame.  SIM  A does  not  report  RNP  in  its  data  set  so  it  was 
not  possible  to  compute  the  geocentric  gravitation  vector;  however,  the  magnitude  of  the  gravitation  vector 
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could  still  be  compared.  It  is  assumed  that  all  the  simulations  were  using  GEM-T1  coefficients  (ref  [28])  and 
that  those  coefficients  were  the  same.  GEM-T1  coefficients  were  taken  from  SIM  B. 

The  comparison  revealed  that: 

• SIM  B matched  the  Mathematica  model  to  within  machine  precision. 

• SIM  D matched  the  Mathematica  model  to  within  the  precision  of  its  recorded  output  (the  data  set 
had  ten  digits  of  precision) . 

• SIM  C showed  differences  larger  than  the  precision  of  its  output  for  all  three  geocentric  axes.  In  fact, 
the  differences  were  larger  than  the  contributions  of  some  of  the  degree-order  pairs  in  the  spherical 
harmonic  series.  Therefore,  the  accuracy  of  its  results  appeared  to  be  slightly  reduced  from  that  of 
SIM  B and  SIM  D. 

• The  magnitude  error  for  SIM  A suggests  that  it  may  be  using  an  algorithm,  like  SIM  C,  that  exhibited 
reduced  accuracy  for  the  initial  condition. 

Differences  in  inertial  velocity  followed  the  differences  in  gravitation.  In  turn,  they  drove  the  differences 
in  inertial  position.  Differences  in  Earth-relative  position  were  a combination  of  the  differences  in  inertial 
position,  the  differences  in  the  initial  RNP  orientation  of  the  Earth,  and  differences  in  how  the  RNP  trans- 
formation was  updated  during  the  simulation.  As  explained  in  orbital  case  2 (Section  D.2.1),  SIM  A differed 
in  initial  RNP  orientation  from  the  other  simulations  because  it  used  ITRF93  instead  of  ITRF89  as  the 
reference  figure  for  the  Earth.  The  Earth-relative  position  for  SIM  D diverged  from  SIM  B and  SIM  C,  in 
part,  because  SIM  D updated  the  Earth  RNP  transformation  matrix  using  a simple  z-axis  rotation;  SIM  B 
and  SIM  C updated  the  full  RNP  model  each  frame. 

Differences  in  angular  rates,  inertial  Euler  angles,  and  LVLH  Euler  angles  were  identical  to  those  seen  in 
orbital  case  2 and  are  attributed  to  differences  in  integration  method.  Though  the  orbits  differed  slightly 
due  to  the  differences  in  the  computed  gravity  vector,  those  differences  were  not  large  enough  in  this  case  to 
affect  the  orbit-relative  LVLH  Euler  angles. 
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D.2.3  Check-case  03B  — ISS  in  8 x 8 harmonic  gravity 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  the  ISS  in 
orbit  with  a 8 x 8 harmonic  gravity  model  and  no  disturbances.  This  scenario  is  described  in  Section  C.2.3. 
Figures  39a  through  39p  compare  results  between  the  four  simulation  tools,  as  well  as  the  deviances  of  the 
outputs  from  each  tool  from  the  ensemble  average  value. 

This  check-case  extended  orbital  check-case  3A  by  increasing  the  degree  and  order  of  the  gravitation  model 
to  eight  (8x8).  The  differences  observed  among  the  simulations  were  consistent  with  the  differences  in  the 
accuracy  of  gravitation  model  implementations  as  described  in  orbital  case  3A.  Nevertheless,  under  the  8x8 
gravitational  configuration,  the  differences  in  translational  states  appeared  more  erratic  but,  in  magnitude, 
was  of  the  same  order  as  the  difference  noted  in  orbital  case  3A. 

Rotational  state  differences  were  unchanged  from  orbital  case  3A  and  are  attributed  to  differences  in  inte- 
gration methods. 
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D.2.4  Check-case  04  — ISS  with  third-body  disturbances 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  the  ISS 
in  orbit  with  Sun  and  Moon  gravity  perturbations.  This  scenario  is  described  in  Section  C.2.4.  Figures  40a 
through  40p  compare  results  between  the  four  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from 
each  tool  from  the  ensemble  average  value. 

This  check-case  applied  gravitational  forces  from  the  Sun  and  Moon  to  the  orbiting  ISS.  The  ephemerides 
of  the  Sun  and  Moon  were  computed  using  the  DE405  high-accuracy  ephemeris  data  set  published  by  the 
Jet  Propulsion  Laboratory  [26].  To  isolate  differences  due  to  ephemeris  calculations,  the  gravitation  of  the 
Earth  was  modeled  as  a spherically  symmetric  mass. 

In  general,  the  translation  states  predicted  by  the  simulations  remained  in  agreement.  The  largest  difference 
in  inertial  position  among  the  simulations  during  the  simulated  8-hour  period  were  less  than  2 cm.  Differences 
in  Earth-relative  position  were  due  to  the  same  causes  described  in  orbital  check-case  2. 

Rotational  state  differences  were  similar  to  those  of  the  previous  test  cases  and  were  attributed  to  differences 
in  integration  methods. 
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D.2.5  Check-case  05A  — ISS  (minimal  solar  activity) 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  the  ISS 
in  orbit  with  minimal  solar  activity  disturbances.  This  scenario  is  described  in  Section  C.2.5.  Figures  41a 
through  41p  compare  results  between  the  four  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from 
each  tool  from  the  ensemble  average  value. 

Orbital  test  check-cases  5A  through  5C  compared  the  atmospheric  properties  predicted  by  the  simulations. 
Simulations  were  asked  to  use  the  MET  model  [18]  to  predict  the  atmospheric  temperature  and  density  in 
the  thermosphere.  Atmospheric  temperature  and  density  are  subject  to  the  solar  radiation  flux;  this  case  set 
the  solar  radiation  flux  for  minimum  solar  activity.  The  MET  model  is  a function  of  the  geodetic  position  of 
the  vehicle;  therefore  differences  in  the  Earth-relative  position  of  the  vehicle  can  cause  small  differences  in  the 
predicted  atmospheric  properties.  However,  the  dominant  contributor  to  differences  among  the  simulation 
tools’  predicted  orbits  was  the  differing  versions  of  MET  used  by  different  simulation  tools.  SIM  A used 
MET07.  SIM  B and  C used  MET99.  SIM  D used  MET95.  (MET95  was  the  model  provided  as  a reference  to 
teams  that  did  not  have  an  existing  implementation  of  the  MET  model.)  As  seen  in  plots  of  the  atmospheric 
properties,  MET95  and  MET99  produced  similar  results.  MET07  introduced  a modeling  improvement 
that  differentiated  it  from  MET95  and  MET99.  In  computing  the  atmospheric  properties,  MET95  and 
MET99  used  global,  hard-coded  values  for  surface  gravity  and  effective  radius  for  a spherical  Earth.  MET07 
computed  surface  gravity  and  effective  radius  as  a function  of  latitude  using  WGS-84  parameters  (i.e.,  an 
ellipsoid  Earth). 

A secondary  contributor  to  the  differences  in  atmospheric  properties  between  SIM  A and  the  other  simulations 
was  the  difference  in  computed  altitude.  The  difference  in  altitude  was  greater  than  the  difference  in  the 
ECEF  position  vector.  This  indicated  a difference  in  the  accuracy  of  the  method  used  to  convert  ECEF 
position  to  geodetic  position.  SIM  A also  exhibited  a spike  in  its  temperature  and  density  difference  with 
the  other  simulations  at  t = 0.  This  was  likely  an  artifact  of  the  simulation’s  recording  or  initialization 
functions. 

This  check-case  scenario  first  introduced  the  initial  conditions  for  a highly  elliptical  orbit  but  modeled  the 
Earth  as  a spherically  symmetric  mass  in  order  to  isolate  differences  in  the  atmospheric  properties  to  the 
thermosphere  model.  Differences  in  translational  states  among  the  simulations  were  similar  to  orbital  check- 
case  2.  Differences  in  inertial  states  were  attributed  to  differences  in  integration  method.  Differences  in 
Earth-relative  states  were  attributed  to  differences  in  the  initial  RNP  matrix  for  the  Earth  and  to  differences 
in  the  propagation  of  RNP.  See  Section  D.2.1  for  more  details.  Differences  in  rotational  state  were  also 
similar  to  orbital  case  2 and  were  attributed  to  differences  in  integration  methods. 
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D.2.6  Check-case  05B  — ISS  (mean  solar  activity) 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  the  ISS  in 
orbit  with  mean  solar  activity  disturbances.  This  scenario  is  described  in  Section  C.2.6.  Figures  42a  through 
42p  compare  results  between  the  four  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each 
tool  from  the  ensemble  average  value. 

Orbital  check-cases  5A  through  5C  compared  the  atmospheric  properties  predicted  by  the  simulations.  Sim- 
ulations were  required  to  implement  the  MET  model  [18]  to  predict  the  atmospheric  temperature  and  density 
in  the  thermosphere.  Atmospheric  temperature  and  density  are  subject  to  the  solar  radiation  flux;  this  case 
set  the  solar  radiation  flux  for  mean  solar  activity.  The  MET  model  is  a function  of  the  geodetic  position  of 
the  vehicle;  therefore  differences  in  the  Earth-relative  position  of  the  vehicle  can  cause  small  differences  in  the 
predicted  atmospheric  properties.  The  differences  in  atmospheric  properties  among  simulations  B,  C,  and 
D were  the  result  of  using  different  versions  of  the  MET  model,  as  noted  for  check-case  5A.  However,  those 
differences  were  masked  by  the  results  of  SIM  A which  appeared  to  have  been  somewhat  misconfigured: 
the  ECEF  position,  geodetic  altitude  and  atmospheric  temperature  recorded  for  SIM  A were  a constant 
zero;  the  atmospheric  density  was  a negative  value.  Likewise,  SIM  A produced  a constant  zero  for  inertial 
acceleration, velocity,  and  position.  The  same  was  true  for  the  rotational  states. 

Agreement  in  translational  and  rotational  states  among  SIM  B,  C,  and  D was  unchanged  from  orbital  case  5 A 
(see  Section  D.2.5). 
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D.2.7  Check-case  05C  ISS  (maximal  solar  activity) 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  the  ISS 
in  orbit  with  maximal  solar  activity  disturbances.  This  scenario  is  described  in  Section  C.2.7.  Figures  43a 
through  43p  compare  results  between  the  four  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from 
each  tool  from  the  ensemble  average  value. 

Orbital  check-cases  5A  through  5C  compared  the  high-altitude  atmospheric  properties  predicted  by  the  sim- 
ulations. Simulations  were  expected  to  the  use  the  MET  model  [18]  to  predict  the  atmospheric  temperature 
and  density  in  the  thermosphere.  Atmospheric  temperature  and  density  are  subject  to  the  solar  radiation 
flux;  this  check-case  set  the  solar  radiation  flux  for  maximum  solar  activity.  As  explained  in  the  discussion 
for  orbital  case  5A  (see  Section  D.2.5),  the  differences  in  atmospheric  properties  among  the  simulations  were 
primarily  caused  by  differences  in  the  version  of  the  MET  model  used  by  each  simulation.  A secondary 
contributor  to  the  differences  in  atmospheric  properties  between  SIM  A and  the  other  simulations  was  a 
difference  in  computed  altitude.  The  difference  in  altitude  was  attributed  to  a difference  in  the  accuracy  of 
the  method  used  to  convert  ECEF  position  to  geodetic  position.  As  in  orbital  case  5A,  SIM  A also  exhibited 
a spike  in  its  temperature  and  density  difference  at  t = 0.  This  difference  appears  to  be  an  artifact  of  the 
simulation’s  recording  or  initialization  function. 

Differences  in  translational  and  rotational  state  were  identical  to  the  results  of  orbital  case  5A. 
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D.2.8  Check-case  06A  — sphere  with  fixed  drag 

This  section  shows  cross-plots  for  three  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a sphere 
in  orbit  with  fixed  drag.  This  scenario  is  described  in  Section  C.2.8.  Figures  44a  through  44p  compare 
results  between  the  three  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each  tool  from  the 
ensemble  average  value. 

Orbital  check-case  6A  was  the  first  of  four  test  cases  that  applied  external  forces  other  than  gravitation  to 
the  vehicle.  This  test  case  applied  aerodynamic  drag  and  used  a constant  density  to  isolate  differences  in  the 
modeling  or  processing  of  aerodynamic  effects.  Among  the  simulations  SIM  B and  SIM  C showed  agreement 
in  translational  and  rotational  states.  SIM  D departed  from  SIM  B and  C in  the  translational  states  and 
the  orbit-relative  LVLH  orientation  because  the  simulation  had  apparently  not  applied  aerodynamic  drag. 
SIM  D’s  results  were  identical  to  its  results  for  orbital  case  2. 

As  shown  on  the  plots  for  density  (Figure  44d),  SIM  B and  SIM  C recorded  density  as  calculated  by  the 
MET  model.  However,  both  simulations  did  appear  to  replace  those  values  with  a constant  density  term  in 
computation  of  aerodynamic  drag  as  requested. 
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D.2.9  Check-case  06B  — sphere  with  dynamic  drag 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a sphere 
in  orbit  with  dynamically  varying  drag.  This  scenario  is  described  in  Section  C.2.9.  Figures  45a  through 
45p  compare  results  between  the  four  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each 
tool  from  the  ensemble  average  value. 

Orbital  check-case  6B  was  the  second  of  four  test  cases  that  applied  external  forces  other  than  gravitation  to 
the  vehicle.  This  test  case  applied  aerodynamic  drag  using  the  atmospheric  density  predicted  by  the  MET 
model.  Thus,  differences  in  MET  implementation  or  its  Earth-relative  inputs  could  affect  results.  Orbital 
cases  5A  though  5C  revealed  that  the  simulations  implemented  different  versions  of  the  MET  model  and 
that  the  different  versions  were  the  primary  cause  of  atmospheric  density  differences  among  the  simulations. 
MET07  (used  by  SIM  A)  estimates  of  atmospheric  density  were  up  to  3%  larger  than  MET99  and  MET95. 
This  difference  in  density  was  the  major  contributor,  via  aerodynamic  drag,  to  the  differences  in  the  SIM  A 
translational  state  and  orbit-relative  LVLH  orientation.  MET99  and  MET95  models  more  closely  agreed  on 
estimated  density  and,  therefore,  generated  smaller  translational  state  differences  between  SIM  B,  SIM  C, 
and  SIM  D. 

The  simulations  showed  agreement  in  inertial  rotational  states  among  the  simulations.  SIM  A showed  an 
improvement  in  differences  over  past  check-cases,  possibly  indicating  a change  its  integrator  configuration. 
Overall,  differences  among  the  simulations  were  negligible. 
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D.2.10  Check-case  06C  — cylinder  undergoing  plane  change  firing 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a cylinder 
in  orbit  performing  a plane  change  maneuver  with  intermittent  propulsion.  This  scenario  is  described  in 
Section  C.2.10.  Figures  46a  through  46p  compare  results  between  the  four  simulation  tools,  as  well  as  the 
deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

Orbital  check-case  6C  was  the  third  of  four  test  cases  that  applied  external  forces  other  than  gravitation  to  the 
vehicle.  This  test  case  applied  engine  thrust  to  execute  an  orbital-plane  change  maneuver.  The  engine  thrust 
was  modeled  as  a square  pulse.  A square  acceleration  can  significantly  increase  the  integration  error  for  some 
numerical  methods.  Furthermore,  a single  frame  difference  in  starting  the  pulse  and/or  ending  it  could  have 
significant  impact  on  velocity  and  position  results  over  time,  due  to  the  single-  and  double-integration  of  a 
small  error.  Also,  differences  in  vehicle  orientation  over  the  course  of  the  burn  could  contribute  to  differences 
in  velocity  and  position.  The  data  recording  rate  was  not  fast  enough  to  observe  the  start  and  end  of  the  pulse 
in  each  simulation  nor  was  it  possible  to  identify  the  velocity  that  followed  the  starting  and  ending  frames 
(which  could  have  been  analyzed  for  sudden  jumps  in  integration  error).  Nevertheless,  causes  other  than 
difference  integration  methods  were  ruled  out.  First,  the  differences  in  orientation  between  the  simulations 
were  insignificant  and  did  not  explain  the  observed  differences  in  position  and  velocity.  Next,  SIM  B was 
used  to  explore  the  effects  of  modifying  start  and  end  times  of  the  pulse.  Elongating  the  pulse  by  even 
0.001  sec  caused  much  larger  differences  in  translational  states  than  are  shown  in  the  plots.  Adding  a lead  or 
lag  to  the  pulse  of  up  to  0.01  sec  produced  differences  of  similar  magnitude  but  not  similar  behavior.  Overall, 
the  differences  among  the  simulations  in  AV  following  the  pulse  were  very  small.  The  largest  difference  was 
approximately  0.001  m/s  out  of  a total  AV  of  about  2,700  m/s.  However,  these  small  differences  contributed 
over  time  to  differences  in  inertial  position  of  up  to  100  m after  a simulated  flight  time  of  8 hours. 

The  simulations  agreed  on  inertial  rotational  states;  differences  in  rates  and  attitudes  among  the  simulations 
were  negligible.  Differences  in  the  orbit-relative  LVLH  orientation  were  larger  and  caused  by  the  small 
differences  in  the  orbit  defined  by  the  translational  states. 
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D.2.11  Check-case  06D  — cylinder  undergoing  Earth  departure  firing 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a cylinder 
in  orbit  performing  an  Earth  departure  maneuver  with  continuous  propulsion.  This  scenario  is  described  in 
Section  C.2.11.  Figures  47a  through  47p  compare  results  between  the  four  simulation  tools,  as  well  as  the 
deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

Orbital  test  case  6D  was  the  last  of  four  test  cases  that  applied  external  forces  other  than  gravitation  to 
the  vehicle.  This  test  case  applies  engine  thrust  to  execute  an  Earth  escape  maneuver.  The  engine  thrust 
was  modeled  as  a square  pulse.  As  discussed  in  orbital  case  6C,  a square  pulse  can  significantly  increase  the 
integration  error  for  some  numerical  methods.  The  growth  in  differences  among  the  translational  states  was 
attributed  to  the  differences  in  integration  error  caused  by  the  square  pulse. 

The  simulations  agreed  on  inertial  rotational  states;  differences  among  the  simulations  were  negligible.  Differ- 
ences in  the  orbit-relative  LVLH  orientation  were  larger.  These  were  caused  primarily  by  the  small  differences 
in  the  vehicle  trajectory  among  the  simulations.  Differences  seen  in  the  value  plots  for  the  LVLH  angles 
demonstrated  differences  in  how  each  simulation  resolves  roll  and  yaw  angle  under  the  Euler  angle  singularity 
that  occurred  after  the  vehicle  trajectory  becomes  hyperbolic. 
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D.2.12  Check-case  07A  — sphere  in  4 x 4 gravity  and  third-body  perturbations 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a sphere  in 
orbit  responding  to  a 4 x 4 gravity  model,  planetary  ephemeris,  and  third-body  perturbations.  This  scenario 
is  described  in  Section  C.2.12.  Figures  48a  through  48p  compare  results  between  the  four  simulation  tools, 
as  well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

Orbital  check-case  7A  was  the  first  of  four  test  cases  that  combined  the  geopotential  gravitation  perturbations 
of  orbital  check-case  3A  and  3B,  the  Sun  and  Moon  perturbations  of  orbital  check-case  4,  and  the  aerodynamic 
drag  of  orbital  check-case  6B.  This  scenario  used  the  geopotential  model  of  order  and  degree  four  defined  in 
orbital  case  3A  but  disabled  the  aerodynamic  drag. 

The  differences  in  translational  states  among  the  simulations  was  a combination  of  the  differences  appear- 
ing in  orbital  check-cases  3A  and  4.  Of  these,  the  differences  previously  identified  in  orbital  check-case  3A 
dominated.  Those  differences  were  primarily  caused  by  apparent  differences  in  the  accuracy  of  the  geopo- 
tential model  implementations  among  the  simulations.  See  the  discussion  of  orbital  check-case  3A  difference 
(Section  D.2.2)  for  more  details. 

The  simulations  agreed  on  the  inertial  rotational  state.  Differences  among  the  simulations  were  negligible 
and  were  attributed  to  differences  in  integration  methods.  Differences  in  the  orbit-relative  LVLH  orientation 
were  larger  as  a result  of  the  small  differences  in  orbit  parameters  defined  by  the  translational  states. 
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D.2.13  Check-case  07B  — sphere  in  8 x 8 gravity  and  third-body  perturbations 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a sphere  in 
orbit  responding  to  an  8 x 8 gravity  model,  planetary  ephemeris,  and  third-body  perturbations.  This  scenario 
is  described  in  Section  C.2.13.  Figures  49a  through  49p  compare  results  between  the  four  simulation  tools, 
as  well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

Orbital  check-case  7B  was  the  second  of  four  test  cases  that  combined  the  geopotential  gravitation  perturba- 
tions of  orbital  test  case  3 A and  3B,  the  Sun  and  Moon  perturbations  of  orbital  case  4,  and  the  aerodynamic 
drag  of  orbital  case  6B.  This  check-case  used  the  geopotential  model  of  order  and  degree  eight  defined  in 
orbital  case  3B  but  disabled  aerodynamic  drag. 

The  differences  in  translational  states  among  the  simulations  was  a combination  of  the  differences  appearing 
in  orbital  test  check-cases  3B  and  4.  Of  these,  the  differences  from  orbital  test  check-case  3B  dominated. 
Those  differences  were  primarily  caused  by  apparent  differences  in  the  accuracy  of  the  geopotential  model 
implementations  among  the  simulations.  See  the  discussion  of  orbital  check-case  3A  difference  (Section  D.2.2) 
for  more  details. 

The  simulations  agreed  on  the  inertial  rotational  state.  Differences  among  the  simulations  were  negligible 
and  were  attributed  to  differences  in  integration  methods.  Differences  in  the  orbit-relative  LVLH  orientation 
were  larger  as  a result  of  the  small  differences  in  orbit  parameters  defined  by  the  translational  states. 
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D.2.14  Check-case  07C  — sphere  in  4 x 4 gravity  with  drag  and  third-body  perturbations 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a sphere 
in  orbit  responding  to  a 4 x 4 gravity  model,  atmospheric  drag,  planetary  ephemeris,  and  third-body  per- 
turbations. This  scenario  is  described  in  Section  C.2.14.  Figures  50a  through  50p  compare  results  between 
the  four  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average 
value. 

Orbital  check-case  7C  was  the  third  of  four  test  cases  that  combined  the  geopotential  gravitation  perturba- 
tions of  orbital  test  case  3 A and  3B,  the  Sun  and  Moon  perturbations  of  orbital  case  4,  and  the  aerodynamic 
drag  of  orbital  case  6B.  This  check-case  used  the  geopotential  perturbations  of  order  and  degree  four  defined 
in  orbital  case  3A. 

The  differences  in  translational  states  among  the  simulations  was  a combination  of  the  differences  appearing 
in  orbital  check-cases  3A,  4,  and  6B.  Differences  for  the  translation  states  in  SIM  A were  primarily  caused  its 
unique  use  of  the  MET07  model  to  predict  the  atmospheric  density  input  to  the  aerodynamic  drag.  By  com- 
parison, differences  among  the  other  simulations  barely  registered  on  the  plots.  These  differences  were  likely 
caused  by  apparent  differences  in  accuracy  of  the  geopotential  gravitation  implementation  and  differences  in 
atmospheric  density  predicted  by  the  MET95  and  MET99  models.  See  orbital  case  3A  (Section  D.2.2)  for 
more  details  on  the  apparent  accuracy  differences  in  geopotential  gravitation  implementation  and  see  orbital 
case  5A  (Section  D.2.5)  for  more  details  on  the  differences  among  the  MET  model  versions  in  predicting 
atmospheric  density. 

The  simulations  agreed  on  the  inertial  rotational  state.  Differences  among  the  simulations  were  negligible 
and  were  attributed  to  differences  in  integration  error.  Differences  in  the  orbit-relative  LVLH  orientation 
were  larger  as  a result  of  the  small  differences  in  orbit  parameters  defined  by  the  translational  states. 
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D.2.15  Check-case  07D  — sphere  in  8 x 8 gravity  with  drag  and  third-body  perturbations 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a sphere 
in  orbit  responding  to  an  8 x 8 gravity  model,  atmospheric  drag,  planetary  ephemeris,  and  third-body 
perturbations.  This  scenario  is  described  in  Section  C.2.15.  Figures  51a  through  51p  compare  results 
between  the  four  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble 
average  value. 

Orbital  check-case  7D  was  the  last  of  four  test  cases  that  combined  the  geopotential  gravitation  perturbations 
of  orbital  test  case  3 A and  3B,  the  Sun  and  Moon  perturbations  of  orbital  case  4,  and  the  aerodynamic  drag 
of  orbital  case  6B.  This  check-case  used  the  geopotential  perturbations  of  order  and  degree  eight  defined  in 
orbital  case  3B. 

The  differences  in  translational  states  among  the  simulations  was  a combination  of  the  differences  appearing 
in  orbital  test  cases  3 A,  4,  and  6B.  Differences  for  the  translation  states  in  SIM  A were  primarily  caused 
its  unique  use  of  the  MET07  model  to  predict  the  atmospheric  density  input  to  the  aerodynamic  drag.  By 
comparison,  differences  among  the  other  simulations  barely  registered  on  the  plots.  These  differences  were 
probably  caused  by  apparent  differences  in  accuracy  of  the  geopotential  gravitation  implementation  and 
differences  in  atmospheric  density  predicted  by  the  MET95  and  MET99  models.  See  orbital  case  3A  (Sec- 
tion D.2.2)  for  more  details  on  the  apparent  accuracy  differences  in  geopotential  gravitation  implementation 
and  see  orbital  case  5A  (Section  D.2.5)  for  more  details  on  the  differences  among  the  MET  model  versions 
in  predicting  atmospheric  density. 

The  simulations  agreed  on  the  inertial  rotational  state.  Differences  among  the  simulations  were  negligible 
and  were  attributed  to  differences  in  integration  error.  Differences  in  the  orbit-relative  LVLH  orientation 
were  larger  as  a result  of  the  small  differences  in  orbit  parameters  defined  by  the  translational  states. 
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D.2.16  Check-case  08A  ISS  free  rotation  with  zero  rates 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  the  ISS  in 
torque-free  rotation  starting  with  zero  inertial  rate.  This  scenario  is  described  in  Section  C.2.16.  Figures  52a 
through  52p  compare  results  between  the  four  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from 
each  tool  from  the  ensemble  average  value. 

Orbital  check-case  8A  was  the  first  of  two  orbital  cases  to  focus  on  torque-free  rotation.  This  case  defined  an 
initial  rotation  rate  of  zero  relative  to  the  inertial  frame.  Differences  in  rotational  states  between  the  simu- 
lations were  negligible  and  were  attributed  to  differences  in  integration  error  or  differences  in  the  precision 
of  the  recorded  data. 

Differences  in  translational  states  among  the  simulations  were  nearly  identical  to  orbital  case  2 (see  Sec- 
tion D.2.1). 
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D.2.17  Check  -case  08B  — ISS  free  rotation  with  non-zero  rates 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  the  ISS 
in  torque-free  rotation  starting  with  a non-zero  inertial  rate.  This  scenario  is  described  in  Section  C.2.17. 
Figures  53a  through  53p  compare  results  between  the  four  simulation  tools,  as  well  as  the  deviances  of  the 
outputs  from  each  tool  from  the  ensemble  average  value. 

Orbital  check-case  8B  was  the  second  of  two  orbital  cases  to  focus  on  torque-free  rotation.  This  case  defined 
an  initial  rotation  rate  of  zero  relative  to  the  LVLH  frame,  i.e.  an  inertial  rate  that  was  not  zero. 

Differences  in  rotational  states  between  the  simulations  were  negligible  and  were  attributed  to  differences  in 
integration  method  or  differences  in  the  precision  of  the  recorded  data.  The  one  exception  was  the  difference 
in  the  initial  inertial  pitch  rate  for  SIM  D (see  Figure  53f). 

Although  hard  to  see  in  the  plots,  SIM  D recorded  a sudden  jump  in  pitch  rate  from  0 rad/s  at  t = 0 to 
0.0011  rad/s  at  t = 60  sec  (the  next  recorded  frame).  However,  this  jump  appeared  to  be  an  artifact  of  the 
data  recording  as  the  Euler  angles  showed  no  response  to  this  jump.  Nevertheless,  this  jump  was  sufficiently 
large  to  require  the  comparison  plots  to  use  a range  that  was  too  large  to  display  the  differences  between 
the  simulations  in  the  rest  of  the  maneuver.  Even  so,  those  differences  were  similar  in  magnitude  to  the 
differences  seen  in  the  roll  and  yaw  rates. 

Differences  in  translational  states  among  the  simulations  were  nearly  identical  to  orbital  check-case  2 (see 
Section  D.2.1). 
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D.2.18  Check-case  09A  ISS  being  torqued  with  zero  initial  rates 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  the  ISS  in 
responding  to  an  external  torque  starting  with  zero  inertial  rate.  This  scenario  is  described  in  Section  C.2.18. 
Figures  54a  through  54p  compare  results  between  the  four  simulation  tools,  as  well  as  the  deviances  of  the 
outputs  from  each  tool  from  the  ensemble  average  value. 

Orbital  check-case  9 A was  the  first  of  two  cases  that  applied  a torque  to  the  simulated  ISS  spacecraft.  In 
this  case,  the  vehicle  began  with  a zero  rotation  rate  in  the  inertial  frame.  The  torque  was  applied  as  a 
square  pulse.  As  initially  discussed  in  orbital  check-case  6C,  a square  pulse  force  or  torque  can  induce  an 
increase  in  the  integration  error  for  some  integration  methods. 

SIM  B and  SIM  C agreed  on  the  rotational  states;  differences  between  them  were  negligible.  In  comparison 
to  SIM  B and  C,  SIM  D exhibited  a minute  difference  in  angular  momentum  on  the  leading  edge  of  the 
torque  pulse  but  returns  to  near  agreement  with  SIM  B and  SIM  C on  the  trailing  edge  of  the  pulse,  as 
shown  in  Figure  54f.  This  is  one  effect  that  a square  input  can  have  on  integration  error.  (Throughout  this 
assessment,  we  are  making  relative  comparisons;  it  is  certainly  possible  that  SIM  B and  SIM  C experienced 
an  equal  jump  in  integration  error  of  opposite  sign,  relative  to  SIM  D.)  The  amplitude  and  duration  of  the 
difference  in  angular  momentum  caused  the  momentary  spike  in  difference  for  the  LVLH  and  inertial  Euler 
angles,  but  the  long-term  increase  in  difference  was  very  modest.  Moreover,  these  differences  were  considered 
insignificant. 

Also  shown  in  Figure  54f,  SIM  A shows  a minute  difference  in  angular  momentum,  relative  to  the  other 
simulations,  following  the  torque  pulse  that  is  likely  caused  by  a difference  in  integration  method.  This 
minute  difference  in  angular  momentum  caused  the  increasing  difference  in  LVLH  and  inertial  Euler  angles 
over  time.  Overall,  the  differences  were  not  considered  significant. 

Differences  in  translational  states  were  similar  to  the  differences  reported  for  orbital  check-case  2 (see  Sec- 
tion D.2.1).  However,  the  differences  for  SIM  B decreased  significantly  in  this  case  because  SIM  B was 
executed  at  a higher  frame  rate  to  reduce  integration  error  on  the  leading  and  trailing  edge  of  the  square 
pulse  torque. 
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D.2.19  Check-case  09B  — ISS  being  torqued  with  non-zero  initial  rates 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  the  ISS 
in  responding  to  an  external  torque  starting  with  a non-zero  inertial  rate.  This  scenario  is  described  in 
Section  C.2.19.  Figures  55a  through  55p  compare  results  between  the  four  simulation  tools,  as  well  as  the 
deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

Orbital  check-case  9B  was  the  second  of  two  cases  that  applied  a torque  to  the  simplified  ISS.  In  this  case, 
the  vehicle  began  with  a zero  rotation  rate  in  the  LVLH  frame,  i.e.  a non-zero  rate  relative  to  the  inertial 
frame.  As  with  orbital  check-case  9A,  the  torque  was  applied  as  a square  pulse.  As  initially  discussed  in 
orbital  check-case  6C,  a square  pulse  force  or  torque  can  induce  an  increase  in  the  integration  error  for  some 
integration  methods  (see  Section  D.2.10). 

Starting  with  a non-zero  inertial  rotation  did  not  qualitatively  change  the  outcome  of  the  simulation  com- 
parisons as  discussed  in  orbital  case  9A.  As  shown  in  Figure  55f,  SIM  B and  SIM  C agreed  on  the  value  of 
rotational  states;  differences  between  them  were  negligible.  Compared  to  SIM  B and  C,  SIM  D exhibited  a 
minute  difference  in  angular  momentum  at  the  leading  edge  of  the  torque  pulse  but  returns  to  near  agreement 
with  SIM  B and  SIM  C at  the  trailing  edge  of  the  input.  The  amplitude  and  duration  of  the  difference  in 
angular  momentum  caused  the  momentary  spike  in  difference  for  the  LVLH  (Figure  55j)  and  inertial  Euler 
angles,  but  the  long-term  increase  in  difference  was  very  modest.  Moreover,  these  differences  were  consid- 
ered insignificant.  SIM  A shows  a minute  difference  in  angular  momentum,  relative  to  the  other  simulations, 
following  the  torque  pulse  that  is  likely  caused  by  a difference  in  integration  method  (see  Figure  55f).  This 
minute  difference  in  angular  momentum  caused  the  increasing  difference  in  LVLH  and  inertial  Euler  angles 
over  time.  Previously-identified  differences  in  integration  methods  for  torque-free  rotation  in  orbital  case  8B 
also  contributed  to  the  differences  in  Euler  angles.  Overall,  the  differences  were  not  considered  significant. 

Body  pitch  rate  exhibited  an  anomaly  previously  noted  in  orbital  check-case  8B  (Section  D.2.17)  for  SIM  D; 
this  is  not  considered  significant. 

Differences  in  translational  states  were  similar  to  the  differences  in  orbital  check-case  2 (Section  D.2.1). 
However,  the  differences  for  SIM  B decreased  significantly  in  this  case  because  SIM  B was  executed  at  a 
higher  frame  rate  to  reduce  integration  error  on  the  leading  and  trailing  edge  of  the  square  pulse  torque. 
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D.2.20  Check-case  09C  — ISS  under  torque  and  force  with  zero  initial  rates 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  the  ISS 
in  responding  to  external  torque  and  force  starting  with  zero  inertial  rate.  This  scenario  is  described  in 
Section  C.2.20.  Figures  56a  through  56p  compare  results  between  the  four  simulation  tools,  as  well  as  the 
deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

Orbital  check-case  9C  was  the  first  of  two  cases  that  apply  a simultaneous  torque  and  force  to  the  simulated 
ISS  spacecraft.  These  scenarios  examined  the  coupling  of  translational  and  rotational  motion  via  a body- 
fixed  thrust  vector  on  a rotating  body.  In  this  case,  the  vehicle  began  with  a zero  rotation  rate  in  the  inertial 
frame.  The  torque  and  force  were  both  modeled  as  a square  pulse.  As  initially  discussed  in  orbital  case  6C 
(Section  D.2.10),  this  could  have  presented  a problem  for  some  integration  methods. 

SIM  B and  SIM  C showed  agreement  on  both  translational  and  rotational  states.  SIM  A showed  the  same 
differences  in  rotational  states  seen  in  orbital  check-case  9A.  However,  those  differences  were  demonstrated  to 
be  insignificant  given  their  negligible  impact  via  the  direction  of  thrust  on  translational  states.  SIM  A showed 
close  agreement  on  translational  states  with  SIM  B and  C.  SIM  A also  demonstrated  the  same  differences  in 
rotational  state  as  orbital  case  9A.  Those  rotational  state  differences  had  a more  noticeable  impact  on  the 
translational  states  via  their  impact  on  the  direction  of  the  thrust  vector.  However,  the  difference  in  position 
remained  below  a decimeter,  a value  not  considered  significant. 
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D.2.21  Check-case  09D  — ISS  under  torque  and  force  with  non-zero  initial  rates 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  the  ISS 
in  responding  to  external  torque  and  force  starting  with  a non-zero  inertial  rate.  This  scenario  is  described 
in  Section  C.2.21.  Figures  57a  through  57p  compare  results  between  the  four  simulation  tools,  as  well  as  the 
deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

Orbital  check-case  9D  was  the  second  of  two  cases  that  applied  a simultaneous  torque  and  force  to  the  ISS 
spacecraft.  These  scenarios  examined  the  coupling  of  translational  and  rotational  motion  via  a body- fixed 
thrust  vector  on  a rotating  body.  In  this  case,  the  vehicle  began  with  a zero  rotation  rate  in  the  LVLH 
frame,  i.e.  a non-zero  rotation  rate  in  the  inertial  frame.  The  torque  and  force  were  both  applied  as  a square 
pulse.  As  initial  discussed  in  orbital  case  6C,  a square  pulse  force  or  torque  can  induce  an  increase  in  the 
integration  error  for  some  integration  methods. 

The  differences  in  rotational  state  were  identical  to  the  differences  for  the  previous  scenario  (orbital  case  9B). 
For  SIM  A,  SIM  B,  and  SIM  C,  those  rotational  state  differences  did  not  contribute  significantly  to  the 
differences  in  translational  state,  as  a result  of  influencing  the  direction  of  the  thrust  vector.  The  differences 
in  translational  state  were  negligible. 

SIM  D,  however,  exhibited  Euler  angle  differences  due  to  differences  in  integration  residues  for  both  the  initial 
rotation  rate  and  the  applied  torque.  Those  integration  differences  combined  to  increase  the  translational- 
state  differences  similar  to  the  differences  SIM  D exhibited  in  orbital  check-case  9C.  The  difference  in  inertial 
position  increased  from  less  than  1 decimeter  to  less  than  2 m at  the  end  of  the  simulated  eight  hour  flight. 
However,  the  differences  are  entirely  attributed  to  combined  differences  in  integration  method  and  not  to  any 
differences  in  modeling  or  equations  of  motion.  Thus,  whether  it  was  SIM  D or  the  other  three  simulations 
exhibiting  increased  integration  residue,  the  integrators  could  likely  be  reconfigured  to  reduce  the  residue  in 
position  if  an  application  required  greater  accuracy  in  results. 
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D.2.22  Check-case  10A  cylinder  in  circular  orbit  with  gravity  gradient  with  zero  initial 
rates 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a cylinder 
in  low  Earth  orbit  responding  to  the  gravity  gradient  starting  with  zero  inertial  rate.  This  scenario  is 
described  in  Section  C.2.22.  Figures  58a  through  58p  compare  results  between  the  four  simulation  tools,  as 
well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

Orbital  check-case  10A  was  the  first  of  four  scenarios  to  assess  the  modeling  and  application  of  gravity 
gradient  torque  among  the  simulations.  This  test  case  initialized  the  cylindrical  vehicle  to  a near  circular 
orbit  with  a initial  rate  of  zero  relative  to  the  LVLH  frame. 

The  simulations  demonstrated  close  agreement  on  the  inertial  rotational  states.  The  negligible  differences 
that  remained  were  attributed  to  differences  in  integration  method  or  differences  in  the  precision  of  recorded 
outputs.  Likewise,  the  simulations  showed  close  agreement  on  the  inertial  translational  states.  Despite  this 
agreement  on  inertial  orientation  and  orbit,  SIM  C reported  LVLH  Euler  angles  that  differ  substantially 
from  the  other  simulations  (see  Figure  58j).  Such  differences  were  not  exhibited  in  prior  test  cases.  Thus, 
it  appears  that  SIM  C may  have  been  configured  with  a different  Euler  angle  convention  or  different  LVLH 
definition  for  these  check-cases. 

The  differences  in  ECEF  position  among  the  simulations  were  identical  to  orbital  case  2 with  the  simulations 
differing  by  less  than  0.3  m after  a simulated  8-hour  flight.  However,  the  difference  in  altitude  of  up  to  33  m 
exhibited  by  SIM  A in  this  case  were  much  larger  than  the  approximately  2 m difference  seen  in  orbital 
case  2 (Section  D.2.1).  Thus,  it  appeared  that  SIM  A may  have  been  configured  with  a different  set  of  Earth 
surface  modeling  parameters  for  this  check-case. 
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D.2.23  Check-case  10B  — cylinder  in  circular  orbit  with  gravity  gradient  with  non-zero  initial 
rates 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a cylinder 
in  low  Earth  orbit  responding  to  the  gravity  gradient  starting  with  a non-zero  inertial  rate.  This  scenario  is 
described  in  Section  C.2.23.  Figures  59a  through  59p  compare  results  between  the  four  simulation  tools,  as 
well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

Orbital  check-case  10B  was  the  second  of  four  scenarios  to  assess  the  modeling  and  application  of  gravity 
gradient  torque  among  the  simulations.  This  test  case  initialized  the  cylindrical  spacecraft  to  a near  circular 
orbit  with  a initial  pitch  rate  of  0.01  deg/s  relative  to  the  LVLH  frame. 

The  introduction  of  an  initial  pitch  rate  in  the  LVLH  frame  did  not  qualitatively  change  the  simulation 
comparison  as  described  in  orbital  check-case  10A.  The  simulations  demonstrated  close  agreement  on  the 
inertial  rotational  states.  The  negligible  differences  that  remained  were  attributed  to  differences  in  integration 
method  or  differences  in  the  precision  of  recorded  outputs.  Likewise,  the  simulations  showed  close  agreement 
on  the  inertial  translational  states.  Despite  this  agreement  on  inertial  orientation  and  orbit,  SIM  C reported 
LVLH  Euler  angles  that  differ  substantially  from  the  other  simulations,  as  shown  in  Figure  59j.  Such 
differences  were  not  exhibited  in  test  cases  prior  to  check-case  10A.  Thus,  it  appears  that  SIM  C may  have 
been  configured  with  a different  Euler  angle  convention  or  different  LVLH  definition  for  these  check-cases. 

The  differences  in  ECEF  position  among  the  simulations  were  identical  to  orbital  case  2 with  the  simulations 
differing  by  less  than  0.3  m after  8 hours,  with  the  exception  of  SIM  A as  noted  in  the  previous  check-case. 
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D.2.24  Check-case  IOC  — cylinder  in  elliptical  orbit  with  gravity  gradient  with  zero  initial 
rates 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a cylinder 
in  an  elliptical  orbit  responding  to  the  gravity  gradient  starting  with  zero  inertial  rate.  This  scenario  is 
described  in  Section  C.2.24.  Figures  60a  through  60p  compare  results  between  the  four  simulation  tools,  as 
well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

Orbital  check-case  10C  was  the  third  of  four  scenarios  to  assess  the  modeling  and  application  of  gravity 
gradient  torque  among  the  simulations.  This  test  case  initialized  the  vehicle  to  a highly  elliptical  orbit  with 
a initial  rate  of  zero  relative  to  the  LVLH  frame. 

The  change  to  a highly  elliptical  orbit  did  not  qualitatively  change  the  simulation  comparison  as  described 
in  orbital  case  10A.  The  simulations  demonstrated  close  agreement  on  the  inertial  rotational  states.  The 
negligible  differences  that  remained  were  attributed  to  differences  in  integration  methods  or  differences  in  the 
precision  of  recorded  outputs.  Likewise,  the  simulations  showed  close  agreement  on  the  inertial  translational 
states.  Despite  this  agreement  on  inertial  orientation  and  orbit,  SIM  C reported  LVLH  Euler  angles  that 
differ  substantially  from  the  other  simulations.  Such  differences  were  not  exhibited  in  check-cases  prior 
to  check-case  10A.  Thus,  it  appears  that  SIM  C may  have  been  configured  with  a different  Euler  angle 
convention  or  different  LVLH  definition  for  these  check-cases. 

The  differences  in  ECEF  position  among  the  simulations  were  identical  to  orbital  check-case  5A  with  the 
simulations  differing  by  less  than  1 m after  8 hours  of  simulated  flight.  However,  the  difference  in  altitude  of 
up  to  60  m exhibited  by  SIM  A in  this  case  was  much  larger  than  the  2-m  difference  seen  in  orbital  case  5A. 
Thus,  it  appeared  that  SIM  A may  have  been  configured  with  a different  set  of  Earth  surface  modeling 
parameters  for  this  run. 
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D.2.25  Check-case  10D  — cylinder  in  elliptical  orbit  with  gravity  gradient  with  non-zero  initial 
rates 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  a cylinder 
in  an  elliptical  orbit  responding  to  the  gravity  gradient  starting  with  a non-zero  inertial  rate.  This  scenario 
is  described  in  Section  C.2.25.  Figures  61a  through  61p  compare  results  between  the  four  simulation  tools, 
as  well  as  the  deviances  of  the  outputs  from  each  tool  from  the  ensemble  average  value. 

Orbital  check-case  10D  was  the  last  of  four  scenarios  to  assess  the  modeling  and  application  of  gravity 
gradient  torque  among  the  simulations.  This  test  case  initialized  the  cylindrical  vehicle  in  a highly  elliptical 
orbit  with  a initial  pitch  rate  of  0.01  deg/s  relative  to  the  LVLH  frame. 

The  change  in  initial  rotation  did  not  qualitatively  change  the  simulation  comparison  as  described  in  orbital 
case  10C.  The  simulations  demonstrated  close  agreement  on  the  inertial  rotational  states.  The  negligible 
differences  that  remained  were  attributed  to  differences  in  integration  methods  or  differences  in  the  precision 
of  recorded  outputs.  Likewise,  the  simulations  showed  close  agreement  on  the  inertial  translational  states. 
Despite  this  agreement  on  inertial  orientation  and  orbit,  SIM  C recorded  LVLH  Euler  angles  that  differed 
substantially  from  the  other  simulations.  Such  differences  were  not  exhibited  in  check-cases  prior  to  check- 
case  10A.  Thus,  it  appears  that  SIM  C may  have  been  configured  with  a different  Euler  angle  convention  or 
different  LVLH  definition  for  these  check-cases. 

The  differences  in  ECEF  position  among  the  simulations  were  identical  to  orbital  check-case  5A  with  the 
simulations  differing  by  less  than  1 m after  8 hours  of  simulated  flight.  However,  the  difference  in  altitude  of 
up  to  60  m exhibited  by  SIM  A in  this  case  was  much  larger  than  the  nearly  2-m  difference  seen  in  orbital 
check-case  5A.  Thus,  it  appeared  that  SIM  A may  have  been  configured  with  a different  set  of  Earth  surface 
modeling  parameters  for  this  run. 
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D.2.26  Check-case  Full  — ISS  responding  to  all  effects 

This  section  shows  cross-plots  for  four  of  the  selected  simulation  tools  in  modeling  the  dynamics  of  the  ISS 
responding  to  all  effects  previously  tested.  This  scenario  is  described  in  Section  C.2.26.  Figures  62a  through 
62p  compare  results  between  the  four  simulation  tools,  as  well  as  the  deviances  of  the  outputs  from  each 
tool  from  the  ensemble  average  value. 

Orbital  check-case  “Full”  applied  all  the  environmental  affects  that  were  tested  in  isolation  in  prior  check- 
cases.  This  included  geopotential  gravitation  perturbations,  Sun  and  Moon  gravitation  perturbations,  gravity 
gradient  torque,  and  aerodynamic  drag. 

In  the  inertial  translational  states,  SIM  A exhibited  the  largest  differences  in  position,  velocity,  and  ac- 
celeration. These  differences  were  primarily  caused  by  the  effect  of  differences  in  the  atmospheric  density 
contribution  to  aerodynamic  drag.  As  explained  in  orbital  check-case  5A,  the  atmospheric  density  predicted 
by  SIM  A differed  by  up  to  3%  from  the  other  simulations  because  it  was  the  sole  simulation  to  run  MET07 
as  the  thermosphere  model.  The  other  simulations  ran  older  versions  (MET99  and  MET95). 

The  translational  differences  seen  in  this  scenario  were  consistent  with  those  seen  for  orbital  check-case  6B 
(aerodynamic  drag)  after  recognizing  that  the  differences  between  vehicles  in  those  two  scenarios  led  to  an 
aerodynamic  deceleration  in  this  case  that  is  about  one-third  of  that  modeled  in  case  6B.  The  aerodynamic 
drag  differences  did  not,  however,  directly  drive  the  differences  in  acceleration.  Instead,  the  slight  increase 
in  deceleration  it  produced  created  a feedback  through  the  gravitation  model  and  caused  the  gravitation 
differences  to  increase  over  time. 

Smaller  differences  in  inertial  velocity  and  position  appeared  among  SIM  B,  SIM  C,  and  SIM  D.  These  differ- 
ences appeared  to  be  caused  by  differences  in  the  accuracy  of  the  geopotential  gravitation  implementations 
as  described  in  orbital  case  3A  as  well  as  the  difference  in  atmospheric  density  predicted  by  MET95  and 
MET99  as  described  in  orbital  case  5A. 

The  differences  in  inertial  position  among  the  simulations  drove  the  differences  in  ECEF  position.  However, 
SIM  A presented  differences  in  altitude  much  larger  than  suggested  by  the  differences  in  ECEF  position. 
These  differences,  however,  were  consistent  with  the  differences  seen  in  orbital  check-cases  10A  through  10D. 
These  differences  were  attributed  to  a likely  change  in  the  configuration  of  the  Earth  surface  parameters 
since  orbital  check-cases  2 through  9D  showed  much  lower  differences  in  altitude. 

For  the  rotational  states,  SIM  D no  longer  matched  the  other  simulations  after  about  an  hour  of  simulated 
flight.  Differences  in  the  modeling  of  the  gravity  gradient  were  ruled  out:  the  gravity  gradient  from  SIM  D 
was  reconstructed  using  the  recorded  inertial  position  and  inertial  attitude  from  the  SIM  D data  file  and 
comparing  it  to  the  gravity  gradient  recorded  in  the  data  file;  the  reconstructed  gravity  gradient  matched 
the  recorded  gravity  gradient  to  less  than  1 x 1CD9  N-m  in  41  frame  samples  examined. 

Differences  in  initial  orientation  and  angular  velocity  were  also  negligible.  However,  the  difference  in  initial 
angular  acceleration  was  unexpected,  given  the  close  match  in  initial  angular  rate  and  gravity  gradient.  In 
fact,  when  the  gravity  gradient  (which  was  the  only  external  torque  in  this  scenario)  was  reconstructed 
from  the  SIM  D data  file  using  the  scenario-defined  inertia  matrix,  the  recorded  angular  velocity,  and  the 
recorded  angular  acceleration,  the  resultant  torque  differed  (in  all  three  components)  from  the  recorded 
gravity  gradient  by  up  to  5.4  N-m  in  the  81  samples  tested. 

When  this  same  reconstruction  was  performed  for  check-case  10A,  the  gravity  gradient  was  reproduced  to 
the  precision  of  the  recorded  data.  One  difference  between  case  10A  and  case  FULL  was  that  the  ISS  vehicle 
has  non-zero  off-diagonal  terms  in  the  inertia  matrix.  A difference  in  treating  the  sign  of  the  off-diagonal 
terms,  a common  simulation  implementation  difference,  was  ruled  out  using  the  reconstruction;  changing 
signs  produced  an  even  larger  difference  with  the  recorded  gravity  gradient. 
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The  other  possible  explanations  were  either  1)  a transcription  error  in  configuring  the  inertia  matrix  or  2) 
a simplifying  assumption  or  an  error  in  applying  the  off-diagonal  terms  to  the  computation  of  the  angular 
accelerations.  Nevertheless,  the  root  cause  for  the  difference  between  SIM  D and  the  other  simulations  could 
not  be  identified. 

The  SIM  D differences  in  rotational  states  dwarfed  the  differences  that  appeared  between  SIM  A,  SIM  B, 
and  SIM  C.  These  simulations  displayed  close  agreement  in  the  difference  charts  for  angular  rate,  inertial 
Euler  angles,  and  LVLH  Euler  angles. 
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E Discussion  of  results 

E.l  Quality  of  matches 

Each  realm  of  check-cases  had  its  own  peculiarities  and  recurring  differences  between  simulation  tools.  Some 
of  these  differences  can  be  explained  fairly  easily;  some  are  as  yet  unexplained.  Of  the  differences  with 
apparent  explanations,  only  a few  trace  back  to  a conscious  decision  to  make  a simplifying  assumption  or  a 
difference  in  engineering  judgment;  most  could  be  improved  with  additional  effort. 

Only  a few  of  these  differences  raised  objectionable  matches  between  a majority  of  at  least  three  simulated 
trajectories,  as  shown  in  the  plots  accompanying  the  Results  section. 

E.1.1  Quantitative  match  of  parameters 

Percent  variation.  A quantitative  measure  can  be  obtained  by  calculating  the  numerical  difference  be- 
tween each  simulation  tool’s  parameter  value  and  a reference  value  (either  the  average  of  the  ensemble,  or 
the  analytical  solution)  at  each  point  of  time  along  the  trajectory  of  a simulated  maneuver,  and  dividing 
that  difference  by  the  maximum  absolute  value  of  that  reference  over  the  entire  maneuver,  expressed  as  a 
percentage: 


r innmax(  K*)  -ulef(t)  ) 

dUpct  = 100 ; p— 

max0<t<tend  Mref  ) 


(38) 


where  u(t)  represents  each  parameter  in  the  comparison  set,  and  ule{(t)  is  the  ensemble  average  or  analytical 
solution  at  time  t. 

As  mentioned  in  Section  D,  angular  measurement  variables  with  limited  ranges  that  wrapped,  such  as  Euler 
angle  and  spherical  coordinates  for  latitude  and  longitude,  had  to  be  compared  in  a special  way  using  the 
angular  difference  equations  from  trigonometry.  It  was  not  meaningful  to  create  an  ensemble  average  from 
which  to  measure  variation,  so  instead  the  values  from  SIM  5 for  the  atmospheric  cases  and  SIM  D for  the 
orbital  cases  were  used  as  benchmarks. 

This  treatment  may  give  an  unfair  advantage  to  SIM  5 and  SIM  D,  as  its  angular  differences  must  necessarily 
be  zero.  However,  it  seemed  the  most  tractable  solution  since  the  results  indicate  the  differences  between 
the  ensemble  of  simulation  tools. 

In  formulating  an  overall  percentage  match  for  the  check-cases,  allowances  were  made  for  the  identified 
differences  and  the  unidentified  differences  that  appeared  to  be  incorrect.  The  allowance  was  to  not  include 
the  incorrect  parameter,  or  in  some  cases,  the  whole  trajectory,  in  calculating  the  percent  error  between 
either  the  ensemble  average,  the  truth  solution  if  available,  or  SIM  5 or  SIM  D for  Euler  angles. 

A second  allowance  was  to  ignore  very  small  parameter  values,  where  no  simulation  calculated  a value  over 
0.001  (larger  than  the  largest  value  of  atmospheric  density)  as  even  small  variations  could  generate  large 
percentage  errors. 


E.l. 2 Atmospheric  scenarios 

This  section  summarizes  the  principal  causes  for  disparities  that  remain  in  the  set  of  trajectories  generated 
by  the  simulation  tools  that  participated  in  the  atmospheric  check-cases. 
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Identified  differences  in  atmospheric  check-cases. 

• Differences  in  numerical  integration  methods. 

• Use  of  tabular  vs.  smooth  atmospheric  properties  models. 

• SIM  2 used  an  incorrect  initial  value  for  velocity  in  some  cases. 

• SIM  2 appears  to  have  used  a truncated  gravitational  constant  in  its  inverse-square  gravitation  model. 

• SIM  2 appears  to  have  recorded  aerodynamic  force  and  gravitational  acceleration  values  one  frame 
later  than  calculated. 

• SIM  3 appears  to  have  interpreted  the  initial  rotation  rates  as  Earth-relative  rather  than  inertial  as 
specified. 

• Each  sim  used  a different  interpretation  of  trimmed  flight,  and  ended  up  starting  the  F-16  scenarios 
from  slightly  different  initial  conditions. 

• SIM  3 incorrectly  reported  zero  aerodynamic  force  reactions  in  first  frame. 

• A small  difference  in  initial  rotation  rate  appears  in  case  9 from  the  results  from  SIM  3. 

• Case  10  highlights  a disagreement  over  the  alignment  of  local  vertical  (geocentric  instead  of  geodetic). 

• Case  10  shows  a likely  Incorrect  geodetic  conversion  by  SIM  2. 

• Different  tools  used  a different  implementation  of  LQR  autopilot  reference  state  vector  (cases  13.1-13.4, 
15,  and  16). 

• Slight  differences  in  timing  of  discrete  events  in  fixed-step  tools  in  cases  13-17. 

• SIM  6 was  unable  to  implement  the  simplified  linear  interpolation  of  mass  properties  called  for  in 
case  17. 

Unidentified  differences  in  atmospheric  check-cases. 

• An  anomaly  appears  in  rolling  moment  for  case  16  results  recorded  by  SIM  4. 

• An  unidentified  bias  appears  in  translational  forces  for  case  9 in  data  recorded  from  SIM  1. 


Atmospheric  mismatch  percentages.  The  maximum  variation  of  each  parameter  reported  by  each 
simulation  tool  that  participated  in  the  atmospheric  check-cases  was  calculated,  using  the  equation  given  in 
Section  E.1.1.  Not  all  reported  values  were  included  in  this  analysis  however.  The  following  signals  were 
ignored  while  identifying  the  worst  percentage  mismatches: 

• Euler  angle  calculations  in  SIM  2 (all  cases),  likely  due  to  integration  method  differences. 

• Unexplained  X-body  force  and  local  gravity  difference  in  SIM  2 (cases  4 & 5). 

• Unexplained  non-zero  value  in  Y-body  force  in  SIM  3 (cases  6,  7,  & 8). 

• F-16  test  cases  (11  through  16,  18  and  19)  for  SIM  2 due  to  large  trim  differences. 
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• Ignored  first  8 sec  for  all  F-16  test  cases  due  to  initial  transients  (all  simulation  tools). 

• Aerodynamic  moments  in  all  cases  for  SIM  2 since  they  appear  to  be  reported  at  the  MRC,  not  the 
CM  as  in  other  simulation  tools. 

• Mismatched  timing  of  pitching  and  rolling  moment  and  X-body  force  transients  during  altitude  change 
test  (check-case  13.1)  for  SIM  4 and  5. 

• Mismatched  timing  of  pitching  moment  transients  during  heading  change  and  course  side-step  maneu- 
vers (check-cases  13.3  and  13.4)  for  SIM  4 and  5. 

• Mismatched  timing  of  rolling  moment  and  X-body  force  transients  during  North  Pole  circumnavigation 
test  (check-case  15)  for  SIM  4 and  5. 

• Tiny  differences  in  vertical  velocity  for  supersonic  trim  fly-out  case  12  that  led  to  large  percentage 
errors  (all  simulation  tools). 

• For  two-stage  rocket  (case  17),  only  one  simulation  tool  included  MET  atmosphere  model  at  higher 
altitudes,  leading  to  large  mismatches  in  atmospheric  properties,  so  density,  temperature,  pressures 
(both  static  and  dynamic),  speed  of  sound,  and  Mach  were  ignored.  Also,  due  to  the  large  effect  of  the 
timing  of  stage  firing/shutdown,  pitch  angle,  flight  path  angle,  and  vertical  velocities  were  considerably 
different  in  flight  of  the  second  stage,  so  differences  in  pitch  angle,  altitude  rate,  and  true  airspeed  were 
ignored. 

The  remaining  signals  were  compared  and  worst-case  percentage  differences  between  them  and  the  reference 
value  over  the  course  of  each  check-case  duration  were  computed  for  each  case,  as  given  in  Tables  77,  79, 
and  81  for  the  simple,  fixed-wing,  and  two-stage  rocket  check-cases,  respectively. 

A summary  by  signal  name  for  all  atmospheric  check-cases  is  given  in  Tables  78,  80,  and  82  for  the  simple, 
fixed-wing,  and  two-stage  rocket  check-cases,  respectively. 

As  can  be  seen  in  Tables  79  and  81,  the  subsonic  maneuvering  (cases  13.x)  and  two-stage  rocket  (case  17) 
were  the  cases  with  the  largest  mismatch  between  one  simulation  tool  and  the  ensemble  average.  These  poor 
matches  were  caused  by  the  timing  of  sharp-edged  inputs  occurring  at  slightly  different  times  in  various  tools, 
as  discussed  for  each  check-case  previously.  As  listed  in  Tables  79  and  80,  the  largest  difference  (19.5%)  was 
between  SIM  5 and  6 in  the  aerodynamic  sideforce  calculation  for  flight  around  the  Equator/IDL  intersection. 
This  difference  was  caused  by  a 0.4-sec  difference  in  the  time  at  which  the  two  simulations  predicted  the 
vehicle  would  intercept  the  desired  circular  track  around  the  Equator/IDL  intersection  and  would  then 
be  commanded,  by  the  autopilot,  to  roll  out  slightly  from  the  30-degree  limited  bank  angle  held  while 
intercepting  the  desired  circular  track  from  inside  the  circle. 

The  second-largest  magnitude  difference  of  16.8%,  listed  in  Tables  81  and  82  occurred  in  vertical  velocity  at 
the  end  of  the  two-stage  rocket  scenario,  where  SIM  6 diverged  in  trajectory  from  SIM  4 and  5 as  shown  in 
Figures  36m  and  36n,  for  reasons  discussed  in  Section  D.1.19. 

Other  sizable  differences  appeared  during  the  F-16  maneuvering  check-cases  and  most  can  be  attributed  to 
slight  timing  differences  of  discrete  events  such  as  when  a control  surface  came  off  a limit  in  position. 
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Table  77.  Largest 
Reference  Value) 


Differences  for  the  Simple  Atmospheric  Check-cases,  By  Check-case  (Percent  of  Largest 


# 

Check-case  name 

See 

Section 

SIM  1 

SIM  2ad 

SIM  3 

SIM  4 

SIM  5 

SIM  6 

Largest 
diff.  (%) 

i 

Dragless  sphere 

D.l.l 

0.139 

0.027 

0.030 

0.029 

0.030 

0.029 

0.139 

2 

Dragless  tumbling  brick 

D.1.2 

0.133 

0.033 

0.035 

0.036 

0.035 

0.133 

3 

Dragless  tumbling  brick  with  damping 

D.1.3 

0.972 

0.065 

0.264 

0.067 

0.072 

0.972 

4 

Ball  drop  (round  non-rotating  Earth) b 

D.1.4 

9.998 

3.333 

3.333 

3.333 

9.998 

5 

Ball  drop  (round  rotating  Earth) b 

D.1.5 

10.011 

3.337 

3.337 

3.337 

10.011 

6 

Ball  drop  (WGS-84  Earth)c 

D.1.6 

0.142 

0.080 

0.029 

0.030 

0.031 

0.030 

0.142 

7 

Ball  drop  (steady  wind)c 

D.1.7 

0.142 

0.079 

0.044 

0.030 

0.031 

0.030 

0.142 

8 

Ball  drop  (wind  shear) c 

D.1.8 

0.142 

0.153 

0.076 

0.077 

0.076 

0.068 

0.153 

9 

Eastward  ballistic  shot 

D.1.9 

0.106 

0.144 

0.049 

0.039 

0.039 

0.042 

0.144 

10 

Northward  ballistic  shot 

D.1.10 

0.106 

0.281 

0.069 

0.048 

0.048 

0.047 

0.281 

Largest  % difference  for  each  simulation  tool 

0.972 

10.011 

0.076 

3.337 

3.337 

3.337 

10.011 

Key:  | - - ] - no  data  provided 


aSIM  2 Euler  angles  exhibit  large  integration  errors  and  were  not  included  in  any  check-cases. 

^Unexplained  X-body  force  and  local  gravity  differences  appeared  in  SIM  2 results  for  check-cases  4 & 5 and  were  not 
included. 

cUnexplained  non-zero  values  in  Y-body  force  in  SIM  3 (cases  6,  7,  Sz  8)  were  not  included. 

d Aerodynamic  moments  in  all  cases  for  SIM  2 were  not  included  since  they  appear  to  be  reported  at  the  MRC,  not  the  CM 
as  in  other  simulation  tools. 
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Table  78.  Largest  Differences  across  the  Simple  Atmospheric  Check-cases  (1  10),  By  Signal  (Percent  of 
Largest  Reference  Value) 


Parameter  name  (S-119)  SIM  1 SIM  2 SIM  3 SIM  4 SIM  5 SIM  6 | Largest  (%) 


geP  o s i t i on_f  t _X 

gePosition_ft_Y 

gePosition_ft_Z 

f eVelocity_ft_s_X 

f eVelocity_ft_s_Y 

f eVelocity_ft_s_Z 

altitudeMsl.f t 

longitude_deg 

latitude_deg 

localGravity_ft_s2b 

eulerAngle_deg_Yawa 

eulerAngle_deg_Pitcha 

eulerAngle_deg_Rolla 

bodyAngularRateWrtEi_deg_s_Roll 

body  AngularRateWrtEi_deg_s  .Pitch 

bodyAngularRateWrtEi_deg_s_Yaw 

altitudeRateWrtMsl_f  t_min 

speedOf  Sound_ft_s 

airDensity_slug_ft3 

ambientPressure.lbf  _ft2 

amb  i e nt  Temper  at  ure.dgR 

aero.bodyForce.lbf  _Xb 

aero.bodyForce.lbf  _YC 

aero_bodyForce_lbf  _Z 

aero_bodyMoment_ftlbf  _L 

aero_bodyMoment_ftlbf  _Md 

aer  o .bodyMoment  _f  t lbf  JJd 

mach 

dynamicPressure.lbf  _ft2 
t rueAir  speed  jimi_h 


0.000 

0.000 

0.057 

0.076 

0.009 

0.011 

0.012 

0.001 

0.012 

0.007 

0.034 

0.109 

0.044 

0.036 

0.010 

0.091 

0.010 

0.030 

0.022 

0.043 

0.023 

0.016 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.972 

0.000 

0.083 

0.249 

0.000 

0.264 

0.241 

0.000 

0.174 

0.247 

0.049 

0.061 

0.266 

0.065 

0.073 

0.043 

0.006 

0.011 

0.009 

0.081 

0.009 

0.002 

0.005 

0.001 

0.002 

0.090 

0.058 

0.029 

0.029 

0.142 

0.048 

0.037 

0.036 

0.002 

0.010 

0.002 

0.003 

0.033 

3.999 

0.047 

1.333 

0.110 

10.011 

0.069 

3.337 

0.086 

3.337 

0.049 

1.112 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.012 

0.087 

0.029 

0.068 

0.023 

0.010 

0.081 

0.000 

0.000 

0.000 

0.016 

0.017 

0.076 

0.010 

0.009 

0.011 

0.007 

0.007 

0.012 

0.036 

0.036 

0.109 

0.030 

0.030 

0.091 

0.015 

0.014 

0.043 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.043 

0.972 

0.000 

0.016 

0.264 

0.000 

0.032 

0.241 

0.067 

0.072 

0.247 

0.067 

0.062 

0.266 

0.012 

0.013 

0.043 

0.041 

0.041 

0.081 

0.002 

0.002 

0.005 

0.029 

0.029 

0.090 

0.037 

0.037 

0.142 

0.003 

0.003 

0.010 

1.333 

1.333 

3.999 

3.337 

3.337 

10.011 

1.112 

1.113 

3.337 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.029 

0.029 

0.087 

0.023 

0.022 

0.068 

0.041 

0.040 

0.081 

Largest  % diff.  for  each  sim.  tool  0.972  10.011  0.076  3.337  3.337  3.337  | 10.011 


Key: 


0.000 


no  data  provided 

data  provided  but  not  included  in  calculation 


aSIM  2 Euler  angles  exhibit  large  integration  errors  and  were  not  included  in  any  check-cases. 
b Unexplained  X-body  force  and  local  gravity  differences  appeared  in  SIM  2 results  for  check-cases  4 & 5 and 
were  not  included. 

cUnexplained  non-zero  values  in  Y-body  force  in  SIM  3 (cases  6,  7,  Sz  8)  were  not  included. 
d Aerodynamic  moments  in  all  cases  for  SIM  2 were  not  included  since  they  appear  to  be  reported  at  the  MRC, 
not  the  CM  as  in  other  simulation  tools. 
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Table  79.  Largest 
Reference  Value) 


Differences  for  the  Fixed-wing  Aircraft  Check-cases,  by  Check-case  (Percent  of  Largest 


# 

Check-case  name3. 

See 

Section 

SIM  2b 

SIM  4 

SIM  5 

Largest 
diff.  (%) 

li 

Subsonic  aircraft  (trimmed) 

D.l.ll 

0.000 

2.786 

2.786 

2.786 

12 

Supersonic  aircraft  (trimmed) c 

D.1.12 

0.000 

0.631 

0.631 

0.631 

13.1 

Subsonic  aircraft  (altitude  change) d 

D.1.13 

0.000 

1.080 

1.080 

1.080 

13.2 

Subsonic  aircraft  (velocity  change) 

D.1.14 

0.000 

0.218 

0.218 

0.218 

13.3 

Subsonic  aircraft  (heading  change)6 

D.1.15 

0.000 

14.947 

14.947 

14.947 

13.4 

Subsonic  aircraft  (course  offset)6 

D.1.16 

0.000 

16.312 

16.312 

16.312 

15 

Subsonic  aircraft  (North  Pole)f 

D.1.17 

0.000 

11.845 

11.845 

11.845 

16 

Subsonic  aircraft  (intersection) 

D.1.18 

0.000 

19.513 

19.513 

19.513 

Largest  % difference  for  each  simulation  tool 

0.000 

19.513 

19.513 

19.513 

Key: 


0.000 


data  provided  but  not  included  in  calculation 


“The  first  8 sec  for  all  F-16  test  cases  due  to  initial  transients  (all  simulation  tools)  were  not  included. 

6SIM  2 results  are  ignored  for  all  F-16  check-cases  (11  through  16,  18  and  19)  due  to  large  trim  differences. 

cTiny  differences  in  vertical  velocity  for  supersonic  trim  fly-out  case  12  that  led  to  large  percentage  errors  (all 
simulation  tools). 

^Mismatched  timing  of  pitching  and  rolling  moment  and  X-body  force  transients  during  altitude  change  test 
(check-case  13.1)  for  SIM  4 and  5. 

eMismatched  timing  of  pitching  moment  transients  during  heading  change  and  course  side-step  maneuvers 
(check-cases  13.3  and  13.4)  for  SIM  4 and  5. 

•^Mismatched  timing  of  rolling  moment  and  X-body  force  transients  during  North  Pole  circumnavigation  test 
(check-case  15)  for  SIM  4 and  5. 
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Table  80.  Largest  Differences  across  the  Fixed-wing  Aircraft  Check-cases  (11-16),  By  Signal  (Percent  of 
Largest  Reference  Value) 


Parameter  name  (S-119)a 

SIM  2b 

SIM  4 

SIM  5 

Largest  (%) 

gePosition_ft_X 

0.000 

0.000 

gePosition_ft_Y 

0.000 

0.000 

gePosition_ft_Z 

0.000 

0.000 

f eVelocity_f  t_s_X 

0.000 

0.451 

0.451 

0.451 

f eVelocity_ft_s_Y 

0.000 

0.095 

0.095 

0.095 

f eVelocity_ft_s_Zc 

0.000 

7.142 

7.142 

7.142 

altitudeMsl.ft 

0.000 

0.003 

0.003 

0.003 

longitude.deg 

0.000 

0.001 

0.000 

0.001 

latitude_deg 

0.000 

0.000 

0.000 

0.000 

localGravity_ft_s2 

0.000 

0.000 

0.000 

0.000 

euler  Angle  _deg_Y aw 

0.000 

2.660 

0.000 

2.660 

eulerAngle_deg_Pitch 

0.000 

0.528 

0.000 

0.528 

eulerAngle_deg_Roll 

0.000 

2.519 

0.000 

2.519 

body  AngularRateWrtEi_deg_s  .Roll 

0.000 

7.703 

7.703 

7.703 

body  AngularRateWrtEi_deg_s  .Pitch 

0.000 

16.312 

16.312 

16.312 

bodyAngul  arRat  eWrt  Ei  _deg_s  _Y  aw 

0.000 

14.947 

14.947 

14.947 

altitudeRateWrtMsl_ft_min 

0.000 

0.000 

0.000 

speedOf  Sound_ft_s 

0.000 

0.000 

0.000 

0.000 

airDensity_slug_ft3 

0.000 

0.001 

0.001 

0.001 

ambientPressure_lbf  _ft2 

0.000 

0.003 

0.003 

0.003 

amb  i ent  Temp  e r at  ur  e _dgR 

0.000 

0.000 

0.000 

0.000 

aero_bodyForce_lbf  _Xdf 

0.000 

11.619 

11.619 

11.619 

aero_bodyForce_lbf  _Y 

0.000 

19.513 

19.513 

19.513 

aero_bodyForce_lbf  _Z 

0.000 

7.567 

7.567 

7.567 

aer  o_bodyMoment  _f  t lbf  _Ld  f 

0.000 

10.549 

10.549 

10.549 

aero_bodyMoment_ftlbf  _Mde 

0.000 

1.562 

1.562 

1.562 

aero_bodyMoment_ftlbf  _N 

0.000 

12.969 

12.969 

12.969 

mach 

0.000 

0.017 

0.017 

0.017 

dynami  cPr  e s sure  _lbf  _f  1 2 

0.034 

0.034 

0.034 

t r ue  A i r sp  e e d_nm  i Ji 

0.000 

0.000 

0.000 

Largest  % diff.  for  each  sim.  tool 

0.000 

19.513 

19.513 

19.513 

Key: 


0.000 


no  data  provided 

data  provided  but  not  included  in  calculation 


“The  first  8 sec  for  all  F-16  test  cases  due  to  initial  transients  (all  simulation  tools)  were  not  included. 

6SIM  2 results  are  ignored  for  all  F-16  check-cases  (11  through  16,  18  and  19)  due  to  large  trim  differences. 

cTiny  differences  in  vertical  velocity  for  supersonic  trim  fly-out  case  12  that  led  to  large  percentage  errors  (all 
simulation  tools). 

^Mismatched  timing  of  pitching  and  rolling  moment  and  X-body  force  transients  during  altitude  change  test 
(check-case  13.1)  for  SIM  4 and  5. 

eMismatched  timing  of  pitching  moment  transients  during  heading  change  and  course  side-step  maneuvers 
(check-cases  13.3  and  13.4)  for  SIM  4 and  5. 

•^Mismatched  timing  of  rolling  moment  and  X-body  force  transients  during  North  Pole  circumnavigation  test 
(check-case  15)  for  SIM  4 and  5. 
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Table  81.  Largest  Differences  for  the  Two-stage  Rocket  Check-case  (Case  17)  (Percent  of  Largest  Reference 
Value) 


# Check-case  name 

See 

Section 

SIM  4 

SIM  5 

SIM  6 

Largest 
diff.  (%) 

17  Two-stage  rocket3. 

D.1.19 

8.398 

8.391 

16.790 

16.790 

Largest  % difference  for  each  simulation  tool 

8.398 

8.391 

16.790 

16.790 

“One  simulation  tool  included  the  MET  atmosphere  model  while  the  other  two  did  not,  so  density,  temperature, 
pressures  (both  static  and  dynamic),  speed  of  sound,  and  Mach  were  not  numerically  compared.  Also,  due  to  the 
large  effect  of  the  timing  of  stage  firing/shutdown,  pitch  angle,  flight  path  angle  and  vertical  velocities  were 
considerably  different  in  flight  of  the  second  stage,  so  differences  in  pitch  angle,  altitude  rate,  and  true  airspeed 
were  not  compared. 


Table  82.  Largest  Differences  across  the  Two-stage  Rocket  Check-case  (Case  17),  by  Signal  (Percent  of 
Largest  Reference  Value) 


Parameter  name  (S-119)a  SIM  4 SIM  5 SIM  6 | Largest  (%) 


gePosition_ft_X 
gePosition_ft_Y 
f eVelocity_ft_s_X 
f eVelocity_ft_s_Y 
f eVelocity_ft_s_Z 
altitudeMsl_f  t 
longitude_deg 
latitude.deg 
localGravity_ft_s2 
eulerAngle_deg_Yaw 
eulerAngle_deg_Roll 
bodyAngularRateWrtEi_deg_s_Roll 
body  AngularRateWrtEi_deg_s -Pitch 
body  AngularRateWrtEi_deg_s  _Yaw 
altitudeRateWrtMsl_f  t_min 
aero_bodyForce_lbf  _X 
aero_bodyForce_lbf  _Y 
aero_bodyForce_lbf _Z 
aero_bodyMoment_ftlbf  _L 
aero_bodyMoment_ftlbf  _M 
aero_bodyMoment_ftlbf _N 


0.127 

0.127 

0.127 

0.547 

0.547 

0.547 

0.000 

0.000 

0.000 

0.000 

1.263 

1.262 

2.525 

2.525 

8.398 

8.391 

16.790 

16.790 

2.198 

2.195 

4.394 

4.394 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.152 

0.151 

0.303 

0.303 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

2.663 

2.661 

5.324 

5.324 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.421 

0.421 

0.842 

0.842 

0.000 

0.000 

0.000 

0.000 

2.662 

2.659 

5.322 

5.322 

0.000 

0.000 

0.000 

0.000 

3.875 

3.871 

7.746 

7.746 

0.000 

0.000 

0.000 

0.000 

Largest  % diff.  for  each  sim.  tool  8.398  8.391  16.790  I 16.790 


Key:  | - - | - no  data  provided 

“One  simulation  tool  included  the  MET  atmosphere  model  while  the  other  two  did  not,  so  density,  temperature, 
pressures  (both  static  and  dynamic),  speed  of  sound,  and  Mach  were  not  numerically  compared.  Also,  due  to  the 
large  effect  of  the  timing  of  stage  firing/shutdown,  pitch  angle,  flight  path  angle  and  vertical  velocities  were 
considerably  different  in  flight  of  the  second  stage,  so  differences  in  pitch  angle,  altitude  rate,  and  true  airspeed 
were  not  compared. 
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E.1.3  Orbital  scenarios 

This  section  summarizes  the  principal  causes  for  disparities  that  remain  in  the  set  of  trajectories  generated 
by  the  simulation  tools  that  participated  in  the  orbital  check-cases. 

Identified  differences  in  orbital  check-cases. 

• Differences  in  integration  method  employed  by  each  simulation  tool. 

• Disagreement  on  precise  RNP  rotations  (Earth  attitude  with  respect  to  J2000  inertial  frame). 

• Different  versions  of  MET  model  were  employed  by  various  tools. 

• A substantial  gravitational  magnitude  difference  appeared  in  the  results  for  case  3 A recorded  by  SIM  C. 

• Atmospheric  drag  was  not  computed  for  case  6 A by  SIM  D. 

Unidentified  differences  in  orbital  check-cases. 

• Constant  zero  values  were  recorded  for  some  parameters  in  case  5B  by  SIM  A. 

• SIM  A has  a consistent  difference  in  altitude  in  all  check-cases. 


Orbital  mismatch  percentages.  The  maximum  variation  of  each  parameter  reported  by  each  simulation 
tool  that  participated  in  the  orbital  check-cases  was  calculated,  using  the  equation  given  in  Section  E.1.1. 
Not  all  reported  values  were  included  in  this  analysis  however.  The  following  signals  were  ignored  while 
identifying  the  worst  percentage  mismatches: 

• SIM  A values  for  case  5B  appear  corrupted. 

• SIM  D values  for  atmospheric  density  and  ambient  temperature  are  clearly  incorrect. 

• Semi-major  axis  length  calculations  are  widely  different  in  case  6D. 

• Euler  angles  are  significantly  different  for  SIM  C in  the  10A-10D  check-cases. 

• Euler  angles  and  body  angular  rates  are  significantly  different  for  SIM  D in  the  Full  Effects  checkcase. 

The  remaining  signals  were  compared  and  worst-case  percentage  differences  between  them  and  the  reference 
value  over  the  course  of  each  check-case  were  computed  for  each  case,  as  given  in  Table  83. 

A summary  by  signal  name  for  all  orbital  check-cases  is  given  in  Table  84. 

As  listed  in  Table  83,  the  worst  mismatches  between  the  signals  that  remain  viable  occur  in  the  most 
complex  scenario,  the  Full  Effects  check-case  described  in  Section  C.2.26  and  discussed  in  Section  D.2.26. 
The  mismatches  are  in  Euler  angles  for  roll  and  yaw,  as  given  in  Table  84  for  large  values  of  pitch  attitude; 
this  is  due  to  the  singularity  that  exists  in  the  Euler  3-2-1  rotation  sequence  when  close  to  =t?  radians  in 
pitch  angle,  as  discussed  in  Section  E.2.2  in  the  Conventions  for  representing  attitude  discussion. 

Aside  from  the  mismatches  caused  by  proximity  to  the  Euler  ’gimbal  lock’  singularity,  all  signals  matched 
within  0.54  % over  the  typical  28,800  s simulated  orbital  time-frames,  a remarkable  result. 
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Table  84.  Largest  Differences  for  All  Orbital  Check-cases,  by  Signal  (Percent  of  Largest  Reference  Value) 


Parameter  name  (S-119) 

SIM  Aa 

SIM  B 

SIM  C 

SIM  D 

Largest  (%) 

gePosition_m_X 

0.001 

0.003 

0.003 

0.006 

0.006 

gePosition_m_Y 

0.001 

0.004 

0.004 

0.009 

0.009 

gePosition_m_Z 

0.001 

0.004 

0.004 

0.008 

0.008 

eiPosition_m_X 

0.001 

0.004 

0.004 

0.009 

0.009 

eiPosition_m_Y 

0.001 

0.004 

0.004 

0.009 

0.009 

eiPosition_m_Z 

0.001 

0.004 

0.004 

0.008 

0.008 

eiVelocity_m_s_X 

0.001 

0.004 

0.004 

0.009 

0.009 

eiVelocity_m_s_Y 

0.001 

0.004 

0.004 

0.008 

0.008 

eiVelocity_m_s_Z 

0.001 

0.004 

0.004 

0.009 

0.009 

eiAccel_m_s2_X 

0.001 

0.004 

0.004 

0.009 

0.009 

eiAccel_m_s2_Y 

0.001 

0.004 

0.004 

0.009 

0.009 

eiAccel_m_s2_Z 

0.001 

0.004 

0.004 

0.008 

0.008 

semiMajorAxis_mb 

0.000 

0.000 

0.000 

0.000 

0.000 

gast_rad 

0.000 

0.000 

0.000 

0.001 

0.001 

eulerAngle_rad_Rollcd 

2.256 

0.000 

0.281 

0.006 

2.256 

eulerAngle_rad_Pitchcd 

0.516 

0.000 

0.064 

0.004 

0.516 

eulerAngle_rad_Yawcd 

1.967 

0.000 

0.245 

0.006 

1.967 

eulerAngleWrtEi_rad_Rolld 

0.737 

0.000 

0.092 

0.003 

0.737 

eulerAngleWrtEi_rad_Pitchd 

0.334 

0.000 

0.042 

0.000 

0.334 

eulerAngleWrtEi_rad_Yawd 

0.674 

0.000 

0.084 

0.003 

0.674 

bodyAngularRateWrtEi_rad_s_Rolld 

0.383 

0.229 

0.153 

0.000 

0.383 

bodyAngularRateWrtEi_rad_s_Pitchd 

0.537 

0.322 

0.215 

0.001 

0.537 

bodyAngularRateWrtEi_rad_s_Yawd 

0.000 

0.000 

0.000 

0.000 

0.000 

alt itudeMsl_me 

0.015 

0.005 

0.005 

0.007 

0.015 

airDens  i t y _kg_m3e 

0.000 

0.000 

0.000 

0.000 

0.000 

amb i ent T emp e r at ur e _dgK 

0.226 

0.071 

0.063 

0.097 

0.226 

eiGravitation_m_s2_X 

0.001 

0.004 

0.004 

0.009 

0.009 

eiGravitation_m_s2_Y 

0.001 

0.004 

0.004 

0.009 

0.009 

eiGravitation_m_s2_Z 

0.001 

0.004 

0.004 

0.008 

0.008 

Largest  % diff.  for  each  sim.  tool 

2.256 

0.322 

0.281 

0.097 

2.256 

aSIM  A values  for  case  5B  appear  to  be  corrupted  and  were  not  included. 
b Semi-major  axis  length  calculations  are  widely  different  in  case  6D  and  were  not  included. 
cEuler  angles  are  significantly  different  for  SIM  C in  the  10A-10D  check-cases  and  were  not  included. 
“Euler  angles  and  body  angular  rates  are  significantly  different  for  SIM  D in  the  Full  Effects 
checkcase  and  were  not  included. 

eSIM  D values  for  atmospheric  density  and  ambient  temperature  in  case  6A  are  clearly  incorrect 
and  were  not  included. 
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E.2  Corrections  to  improve  matching 

The  assessment  team  went  through  several  comparison  cycles  to  produce  the  results  presented  in  the  report. 
Initial  comparisons  showed  much  larger  differences.  In  some  cases,  simulations  were  effectively  executing 
scenarios  that  differed  in  small  ways  from  each  other  and  from  the  scenario  that  was  intended. 

The  goal  was  to  present  a family  of  simulation  solutions  (time  histories  of  state  and  output  variables)  whose 
differences  were  traceable  only  to  engineering  choices  in  the  modeling  and  implementation  of  the  equations 
of  motion,  implementation  of  the  environment  models,  selection  of  time  step,  or  selection  of  integration 
method.  Therefore,  analysis  of  early  comparison  cycles  attempted  to  identify  and  correct  other  sources  of 
output  variation  including  initial  conditions,  simulation  parameters  (physical  constants  and  unit  conversions), 
simulation  conventions,  output  recording,  and  defects. 

These  corrections  were  intended  to  ensure  that  the  simulations  were  accurately  executing  the  same  scenario 
and  faithfully  reporting  the  same  quantities  at  the  same  time  step  while  avoiding  any  suggestion  that  any 
one  simulation  tool  should  modify  its  implementation  to  conform  to  other  tools.  Not  all  variations  due  to 
simulation  tool  configuration,  recording,  or  possible  defects  were  eliminated  in  the  results  presented  in  this 
report.  Some  are  still  identified  in  the  discussion  of  the  results  in  Volume  1 of  this  report.  This  section 
describes  the  most  prevalent  corrections  that  were  made  prior  to  the  runs  presented  here.  These  corrections 
should  inform  attempts  to  match  the  results  presented  here. 

E.2.1  Simulation  parameters 

For  this  discussion,  the  term  “simulation  parameters”  is  restricted  to  physical  constants  and  unit  conversions. 
At  the  start  of  this  assessment,  not  all  simulation  tools  were  using  the  same  values  for  physical  constants 
and  unit  conversions.  Either  the  value  used  came  from  a different  source  or  the  value  was  not  carried  to  the 
same  digits  of  precision.  Sometimes  this  issue  was  compounded  when  a source  document  presented  different 
units  for  a physical  constant  than  the  native  units  of  the  simulation  tool.  If  so,  a truncated  unit  conversion 
could  lead  to  real  physical  differences  between  simulations  using  SI  units  and  those  using  English  units.  For 
example,  in  one  of  the  early  runs  of  atmospheric  check-case  1,  the  initial  ECEF  X-axis  coordinate  of  the 
sphere  differed  by  up  to  0.7  ft  due  to  a truncation  of  the  meter-to-foot  conversion  for  the  Earth’s  equatorial 
radius. 

Eventually  all  tools  used  the  parameters  presented  in  Tables  73  and  74,  which  improved  matching. 

E.2. 2 Simulation  conventions 

Simulation  tools  were  found  to  have  different  conventions  for  defining  or  naming  quantities.  These  differences 
could  cause  confusion  in  establishing  scenario  consistency  and  comparing  results.  Among  the  simulation 
tools  participating  in  this  assessment,  the  conventions  for  representing  attitude,  the  conventions  for  naming 
output  variables,  the  conventions  for  the  LVLH  frame,  and  conventions  for  products  of  inertia  caused  issues 
in  establishing  good  comparisons. 


Conventions  for  representing  attitude.  Attitude  can  be  represented  using  Euler  angles,  quaternions, 
or  direction  cosine  matrices  (DCMs).  Of  these,  Euler  angles  tend  to  be  the  most  intuitive  to  visualize 
and  are  favored  for  defining  the  initial  state  and  analyzing  results.  However,  there  exist  twelve  different 
conventions  for  Euler  angles.  Use  of  a 3-2-1  (yaw-pitch-roll)  rotation  convention  has  long  been  common 
practice  for  aircraft  simulations.  But  spacecraft  simulations  may  support  differing  conventions  with  3-1-3 
being  a popular  choice  for  orbital  mechanics.  There  was  not  a common  convention  among  the  participating 
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simulation  tools  for  this  rotation  sequence  for  either  initialization  or  recording  and,  in  the  case  of  at  least  one 
of  the  tools,  different  outputs  used  more  than  one  Euler  angle  convention  by  default.  Simulation  runs  could, 
therefore,  err  in  the  Euler  angle  convention  used  for  either  initialization  or  output.  A second  alternative  but 
redundant  representation  could  catch  such  errors. 

Of  the  remaining  two  attitude  representations,  quaternions  are  more  compact  since  they  are  defined  by 
four  scalar  values.  However,  there  exist  in  practice  differing  conventions  for  the  definition  of  quaternions 
since  quaternions  are  not  unique:  quaternion  values  of  opposite  sign  define  the  same  attitude.  Not  all  the 
simulation  tools  participating  in  the  atmospheric  cases  employed  quaternions  to  represent  attitude.  When 
quaternions  were  compared  among  participating  tools  for  the  orbital  cases,  it  was  revealed  that  the  tools 
did  not  share  the  same  quaternion  convention.  In  fact,  one  of  the  tools  used  a convention  that  always  kept 
the  scalar  component  of  the  quaternion  positive.  Thus,  it  was  not  possible  to  compare  quaternions  in  post- 
processing by  simply  changing  quaternion  sign  of  one  or  more  simulation  data  sets.  Thus,  comparison  of 
quaternions  was  abandoned. 

Direct  comparison  of  nine-element  DCMs  as  a representation  of  attitude  was  briefly  entertained  since  the 
DCM  has  a uniform  definition  among  the  simulation  tools.  However,  this  idea  was  also  abandoned  because 
using  a DCM  for  input  and/or  output  would  require  code  changes  to  some  simulation  tools,  including  all 
nine  scalars  comprising  the  DCM  at  each  time  step  would  increase  the  size  of  the  data  files,  and  the  difficulty 
posed  in  extracting  physical  meaning  from  any  DCM  differences. 

This  led  to  a final  decision  to  standardize  on  a 3-2-1  Euler  angle  convention  for  attitude  representation 
for  both  atmospheric  and  orbital  check-cases.  Both  initial  conditions  and  simulation  outputs  used  this 
convention. 

This  decision  required  special  treatment  when  comparing  these  angles,  since  each  Euler  angle  is  typically 
limited  to  a range  of  values  which  must  necessarily  “wrap”  from  one  limit  to  another  as  the  vehicle  rotates. 
Comparing  attitudes  that  are  close  but  are  separated  by  one  of  these  wrappings  was  avoided  by  use  of 
equation  37  discussed  in  Section  D. 

Use  of  the  3-2-1  sequence  of  Euler  angles  to  compare  attitudes  led  to  another  consequence:  an  ambiguity  in 
roll  and  yaw  angles  when  pitch  angle  approaches  ±?  radians,  i.e. , vertical  in  either  sense.  As  will  be  shown 
in  the  “(Quality  of  matches”  section,  some  significant  numerical  mis-matches  resulted. 


Conventions  for  naming  output  variables.  The  naming  convention  for  output  variables  was  unique  to 
each  simulation  tool.  Those  names  often  did  not  unambiguously  define  the  variable.  In  fact,  there  were  a few 
instances  were  similar  variables  names  between  two  tools  referred  to  different  quantities.  The  best  examples 
of  this  were  variables  usually  named  “P,”  “Q,”  or  “R.”  In  some  simulation  tools,  these  variables  represented 
inertial-relative  rotation  rates  presented  in  body  coordinates;  in  other  simulations,  these  variables  represented 
Earth-relative  rotation  rates  in  body  coordinates.  Similar  names  for  dissimilar  quantities  did  lead  to  some 
dissimilar  quantities  being  compared  by  co-plotting.  Also,  it  led  to  some  confusion  over  initial  conditions 
when  one  simulation  team  tried  using  the  outputs  of  another  simulation  team  to  match  initial  conditions. 

Two  steps  were  taken  to  resolve  this  issue.  First,  the  variable  naming  convention  of  the  ANSI/AIAA  S- 
119  standard  [5]  was  adopted  for  labeling  the  plots.  The  S-119  standard  provides  unambiguous  names  for 
states.  Second,  each  simulation  team  was  asked  to  produce  a dictionary  for  the  parameters  in  their  data 
files.  Ultimately,  each  simulation  team  was  responsible  for  ensuring  that  the  output  variable  used  on  each 
plot  was  the  best  match  to  the  S-119  name  on  the  plot. 


Conventions  for  the  Local  Horizontal  Local  Vertical  (LVLH)  frame.  The  LVLH  frame,  used  as  the 
basis  for  vehicle  attitude  relative  to  the  Earth’s  surface,  often  has  a different  definition  in  atmospheric  check- 
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cases  than  in  orbital  check-cases.  The  different  definitions  reflect  different  preferences  of  locally  horizontal 
and  vertical  directions  in  the  aircraft  and  spacecraft  communities. 

In  the  atmospheric  flight  community,  the  local  vertical  is  defined  as  perpendicular  to  the  surface  of  the 
Earth  and  the  local  horizontal  is  tangent  to  the  surface  of  the  Earth.  In  the  space  flight  community,  the 
local  vertical  is  usually  parallel  to  the  geocentric  radial  and  the  local  horizontal  is  perpendicular  to  the 
orbit  plane.  With  the  few  simulation  tools  that  could  attempt  both  the  atmospheric  and  orbital  cases,  early 
atmospheric  case  comparisons  included  a mixture  of  Euler  angles  defined  using  the  orbital  and  atmospheric 
LVLH  conventions.  All  but  one  of  the  simulations  participating  in  the  atmospheric  cases  could  provide  Euler 
angles  using  the  atmospheric  LVLH  convention.  In  cases  where  the  simulation  could  provide  Euler  angles 
under  either  convention,  those  simulations  often  used  a different  name  for  the  atmospheric  LVLH  frame. 

Convention  for  the  products-of-inertia.  When  the  products-of- inertia  ( Ixy , Ixz,  and  Iyz)  appear  in 
the  mass  tensor,  they  usually  have  a negative  sign  (i.e.,  —IXy,  —Ixz,  and  —Iyz)-  Simulation  tools  can  differ 
in  whether  they  expect  input  values  for  the  products-of-inertia  to  include  the  negating  operand.  Therefore, 
for  those  check-cases  where  the  products-of-inertia  were  not  zero,  initial  comparisons  showed  differences  in 
rotational  dynamics  attributed  to  differences  in  the  sign  of  the  products-of-inertia  between  the  simulation 
tools.  These  differences  were  easily  confirmed  by  changing  the  sign  of  the  products-of-inertia  in  one  of  the 
tools  that  differed  and  running  a new  set  of  results.  In  some  cases,  the  sign  confusion  lay  with  the  published 
scenario  and  clarifying  text  was  added  to  the  scenario  description.  In  other  cases,  the  sign  confusion  resulted 
from  user  oversight  in  changing  sign  as  needed  to  match  the  product-of-inertia  convention  for  the  simulation 
tool. 

E.2.3  Initial  conditions 

The  team  attempted  to  define  the  initial  condition  for  each  check-case  unambiguously.  Nevertheless,  early 
comparisons  demonstrated  differences  in  interpretation  or  application  of  initial  conditions.  There  were  a 
number  of  contributors  to  this  confusion: 

• Initial  states  had  to  be  defined  using  multiple  reference  frames  and  coordinate  systems  to  accommodate 
the  variety  of  practices  represented  by  the  simulation  tools.  Managing  and  maintaining  a consistent 
set  of  multiple  state  definitions  was  difficult  and  subject  to  errors. 

• A simulation  team  might  interpret  a published  state  defined  for  one  pair  of  reference  frame  and  co- 
ordinate system  as  if  it  were  defined  for  the  simulation  tool’s  preferred  pair  of  reference  frame  and 
coordinate  system. 

• Problems  with  configuration  file  management:  a simulation  team  occasionally  neglected  to  update 
some  aspect  of  the  configuration  file  when  setting  up  the  next  scenario.  Likewise,  a simulation  team 
occasionally  made  a correction  to  one  set  of  configuration  files  but  failed  to  recognize  that  other 
configuration  files  suffered  from  the  same  issue. 

• Differences  and  limits  in  defining  initial  ECEF  orientation  relative  to  ECI. 

• There  was  confusion  over  the  definition  of  the  initial  altitude,  whether  it  was  geometric,  MSL,  or  above 
ground  level  and  whether  sea-level  or  ground-level  were  different  from  the  reference  ellipsoid  surface. 

• Errors  in  implementing  the  scenarios  caused  some  simulation  tools  to  ignore  certain  non-zero  initial 
conditions  at  t = 0. 
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• Confusion  over  initial  center-of-mass  location  for  F-16  model. 

• Due  to  the  separation  between  orbital  and  atmospheric  simulation  communities,  no  single  document 
existed  that  listed  the  initial  conditions;  there  were  at  least  two  sources  given  initial  values  and,  when 
a better  initial  conditions  document  was  developed,  there  were  three  source  documents. 


Using  multiple  reference  frames  and  coordinate  systems  to  specify  initial  conditions.  Most 
initial  states  (position,  velocity,  etc.)  are  vector  quantities.  A vector  quantity  is  not  only  expressed  in  a 
given  coordinate  system  but  it  may  have  a different  value  depending  on  the  reference  frame  in  which  it  is 
observed.  For  example,  the  vehicle  velocity  has  a different  measured  value  when  observed  in  the  inertial 
frame  than  when  observed  in  an  Earth-fixed  frame  due  to  the  rotation  of  the  Earth-fixed  frame  relative  to 
the  inertial  frame.  Then,  the  measured  velocity  vector  can  have  different  component  values  depending  on  the 
coordinate  system  in  which  it  is  expressed.  An  Earth-relative  vehicle  velocity  expressed  in  NED  coordinates 
necessarily  had  different  component  values  than  when  the  vector  was  expressed  in  body  coordinates.  Thus, 
the  least  ambiguous  manner  to  express  a set  of  initial  vector  quantities  was  to  measure  and  express  them 
in  the  same  frame.  An  initial  attempt  was  made  to  define  all  the  initial  states  using  ECI  as  the  normative 
frame. 

However,  few  of  the  simulation  tools  were  designed  to  accept  an  initial  condition  specification  in  ECI  coor- 
dinates. Often  the  reference  frames  and  coordinate  systems  that  a simulation  tool  accepted  for  defining  the 
vehicle  initial  condition  were  based  on  the  native  frame(s)  for  its  EOM  (e.g.,  ECI,  ECEF,  reference-point 
Cartesian)  and  the  tool’s  previous  history.  The  simulation  tools  simply  reflected  the  variety  of  practices 
common  in  the  aerospace  community  for  defining  scenarios. 

This  was  especially  true  for  the  atmospheric  check-cases.  Atmospheric  simulation  tools  might  accept  a 
position  measured  in  the  Earth-fixed  frame  and  expressed  as  either  geodetic  coordinates  (latitude,  longitude, 
and  altitude)  or  reference-point  relative  Cartesian  coordinates  (e.g.,  runway-relative  coordinates).  Initial 
velocity  was  often  measured  in  the  Earth-fixed  frame  and  expressed  in  either  NED  or  body  coordinates. 
Initial  attitude  was  universally  measured  in  the  Earth- fixed  frame  and  expressed  as  3-2-1  Euler  angles 
relative  to  NED  coordinates.  Initial  rotational  rate  may  be  relative  to  the  inertial  frame,  the  Earth-fixed 
frame,  or  the  atmospheric  LVLH  frame  and  expressed  in  body  coordinates. 

Use  of  multiple  reference  frames  and  coordinates  systems  was  less  prevalent  in  the  orbital  simulation  com- 
munity. Initial  position  and  velocity  vectors  were  acceptable  when  given  relative  to  and  expressed  in  ECI. 
Initial  attitude  was  defined  as  Euler  angles  representing  the  3-2-1  rotation  from  orbital  LVLH  coordinates  to 
body  coordinates.  Only  initial  rotation  rate  switched  between  inertial  and  LVLH  reference  frames  and  was 
represented  in  body  coordinates. 

To  solve  the  initial  condition  incompatibility  problem,  scenario  definitions  were  expanded  to  include  the  vari- 
ety of  reference  frame/coordinate  system  pairs  that  each  of  the  simulation  tools  used  as  inputs.  Initially,  this 
was  done  in  a Microsoft®  PowerPoint  document  that  published  the  original  scenario  definitions.  However, 
as  more  simulation  teams  joined  the  assessment,  the  PowerPoint  document  became  unsuitable  to  publish  and 
maintain  the  growing  list  of  reference  frame/coordinate  system  pairs  and  a Microsoft®  Excel  spreadsheet 
was  created.  The  new  spreadsheet  inadvertently  introduced  discrepancies  in  the  initial  conditions  between 
the  existing  simulation  implementations.  First,  some  teams  originally  working  from  the  PowerPoint  docu- 
ment continued  to  use  the  PowerPoint  document  as  the  source  for  initial  conditions.  Some  initial  condition 
adjustments  made  to  the  spreadsheet  were  not  updated  in  the  PowerPoint  document  and  vice-versa.  Second, 
the  precision  of  physical  parameters  and  unit  conversions  used  the  construction  of  the  spreadsheet  differed 
for  some  states  from  those  used  in  the  PowerPoint  document.  This  caused  a difference  in  the  accuracy 
of  initial  condition  representations  between  the  documents  and  these  differences  manifested  in  some  of  the 
simulation  runs.  Reconciling  the  two  documents  improved  comparisons. 
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Misinterpreting  an  initial  condition.  Before  documentation  of  the  initial  conditions  was  expanded  to 
address  the  variety  of  reference  frames  and  coordinates  systems  used  by  the  simulation  tools,  simulation 
teams  showed  a tendency  to  interpret  the  documented  initial  conditions  in  the  context  of  the  scenario 
definitions,  to  which  they  were  accustomed.  In  essence,  some  initial  condition  values  were  shoehorned  into 
the  preferred  reference  frame/coordinate  system  pair  of  the  simulation  tool.  This  was  most  prevalent  for  the 
initial  angular  rate  under  the  atmospheric  check  cases.  The  initial  angular  rate  that  was  first  published  for  the 
atmospheric  cases  was  measured  in  and  represented  in  ECI  coordinates.  Some  simulation  teams  took  these 
values  and  input  them  directly  into  their  tool  when  their  tool  expected  inertial  angular  rate  represented  in 
body  coordinates,  Earth-relative  angular  rate  represented  in  body  coordinates,  or  atmospheric  LVLH-relative 
angular  rate  represented  in  body  coordinates,  leading  to  poor  matches. 

In  the  next  couple  of  comparison  cycles,  simulations  attempted  to  improve  comparisons  by  matching  the 
initial  angular  rate  reported  by  the  other  simulations.  However,  due  to  differences  in  defining  variables 
angular  rate  variables  (usually  labeled  “P”,  “Q”,  and  “R”,  see  Section  E.2.2),  the  result  was  a consolidation 
into  two  camps.  One  camp  initialized  their  angular  rates  as  intended  (i.e. , consistent  with  the  published 
initial  state),  and  the  other  camp  presented  an  initial  Earth-relative  rate  that  matched  the  inertial  rate  of 
the  first  camp.  In  some  simulations,  outputs  labeled  P,  Q,  or  R were  inertial-relative  and  in  others  they  were 
Earth-relative.  Most  of  these  misinterpretations  have  been  reconciled  through  discussion  and  updates  to  the 
scenario  definitions. 


Issues  managing  configuration  files.  This  assessment  addressed  a set  of  17  atmospheric  check-cases 
and  26  orbital  check-cases.  This  number  of  cases  is  just  large  enough  to  increase  the  chance  of  errors  during 
construction  and  maintenance  of  configuration  files. 

Because  the  check-cases  are  designed  to  incrementally  progress  from  simpler  to  more  complex  scenarios, 
simulation  teams  often  started  the  next  scenario  by  copying  and  tailoring  the  configuration  file  for  a prior 
scenario.  Sometimes,  the  simulation  team  would  overlook  a difference  between  the  current  and  previous 
scenario.  Common  oversights  included: 

• Failing  to  recognize  that  the  Spherical  Earth  check-cases  (Atmospheric  Check-cases  4 and  5)  use  a 
different  radius  than  the  equatorial  radius  defined  for  the  WGS-84  Earth. 

• Failing  to  recognize  when  the  gravitation  model  changed. 

• Failing  to  recognize  when  the  initial  attitude  changed. 

• Failing  to  recognize  when  the  initial  rotation  rate  changed. 

Furthermore,  when  a simulation  team  made  a correction  to  one  or  more  configuration  files  in  response  to 
differences  in  early  comparison  cycles,  the  team  sometimes  failed  to  recognize  all  of  the  configuration  Hies 
that  required  the  same  change.  The  simulation  results  would  then  show  sudden  improvement  or  sudden 
decline  in  the  state  comparisons  of  later  scenarios  relative  to  earlier  scenarios. 


Initial  ECEF  orientation  relative  to  ECI.  For  the  atmospheric  cases,  published  initial  conditions  for 
the  ECI  frame  assumed  that  the  ECEF  and  ECI  coordinate  systems  were  coincident  at  t = 0.  First,  not  all 
of  the  simulation  tools  participating  in  the  atmospheric  cases  calculated  states  in  the  ECI  frame.  Therefore, 
the  initial  conditions  specified  in  the  ECI  frame  had  to  be  converted  into  the  ECEF  frame,  as  well  as  any 
ECEF-referenced  state  outputs.  Second,  one  of  the  simulation  tools  wasn’t  designed  to  arbitrarily  define 
the  attitude  of  the  ECEF  frame  relative  to  the  nECI  frame.  That  tool  used  an  ITRF  model  and  an  initial 
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date  and  time  to  establish  the  initial  orientation  of  the  ECEF  to  the  ECI  frame.  This  team  made  a valiant 
attempt  to  find  a date  and  time  where  the  frames  were  coincident.  The  team  was  able  to  get  very  close, 
reducing  the  difference  to  micro-arcseconds,  but  an  exact  alignment  was  elusive.  Thus,  this  team  worked 
to  assure  that  its  initial  ECEF  state  matched  the  published  initial  condition  and  allowed  the  ECI-to-ECEF 
error  to  affect  the  initial  inertial  state.  Nevertheless,  the  inertial  state  data  remained  useful  when  analyzing 
the  ECEF  state  differences  in  that  simulation  relative  to  other  simulations  that  also  were  able  to  report  ECI 
state.  If  the  differences  were  not  consistent  between  the  two  reference  frames,  then  the  differences  in  one  or 
the  other  frame  likely  had  contributors  other  than  differences  in  integration  methods. 


Definition  of  initial  altitude.  In  the  atmospheric  check-cases,  initial  position  in  the  Earth-fixed  frame 
was  specified  using  geodetic  coordinates:  latitude,  longitude,  and  altitude.  The  intended  initial  altitude 
was  defined  as  geometric,  i.e.  height  above  the  reference  ellipsoid  or  sphere.  However,  some  simulation  tools 
needed  altitude  to  be  expressed  above  ground  level  or  above  MSL  as  an  initial  condition.  Between  PowerPoint 
and  spreadsheet  documentation  of  the  environment  models,  atmospheric  check-cases,  and  initial  conditions, 
there  were  more  than  one  presentation  of  the  Earth’s  radius  in  English  units;  each  version  presented  a 
value  that  differed  by  digits  of  precision  or  by  the  precision  of  the  meter-to-foot  conversion  for  the  WGS-84 
published  value  in  meters,  leading  to  poor  initial  matches,  as  some  teams  interpreted  the  different  altitude 
values  as  the  difference  between  MSL  and  reference  surface  or  elevation  and  reference  surface.  This  was 
clarified  through  discussion. 


Initial  states  not  realized  at  t = 0.  Some  of  the  check-cases  required  the  implementation  of  an  ex- 
ternal force  model,  e.g.,  aerodynamic  drag.  Furthermore,  some  simulation  tools  did  not  initially  have,  and 
needed  to  implement,  new  gravitation  models  (e.g.,  J2).  Some  simulation  tools  also  implemented  code  for 
accepting  initial  conditions  under  references  frames  and  coordinates  systems  not  previously  supported  by 
the  simulation. 

In  some  instances,  the  initial  implementation  failed  to  execute  the  new  code  during  initialization  and  the 
associated  initial  values  remained  at  a default  value  of  zero.  The  new  code  did  not  operate  until  the  first 
time  step.  If  the  associated  state  was  an  integrand  or  an  integrand  was  derived  from  than  state,  the 
initial  default  value  of  zero  would  induce  a jump  in  integration  error  that  would  propagate  a growing  state 
divergence  relative  to  other  simulations.  This  problem  was  most  prevalent  for  atmospheric  cases  7 and  8 
that  introduced  winds.  The  winds  had  a non-zero  initial  magnitude.  Therefore,  the  wind  would  induce  an 
initial  aerodynamic  drag  at  t = 0 even  though  the  initial  world-relative  velocity  of  the  sphere  was  zero.  More 
than  one  simulation  tool  recorded  a non-zero  aerodynamic  drag  at  t = 0 when  they  first  ran  this  scenario. 


Confusion  over  initial  center-of-mass  location  for  F-16  model.  Initially,  the  intended  initial  CM 
location  for  the  F-16  model  was  not  published  with  the  scenario  description.  The  DAVE-ML  model  for  the 
F-16  contained  a default  CM  location  of  35%  mean  aerodynamic  chord  (MAC).  However,  the  README.html 
file  for  the  model  contained  a trim  solution  for  CM  at  25%  MAC.  Thus,  first  comparisons  of  the  F-16  cases 
included  a mix  of  simulations  initializing  the  CM  to  35%  MAC  or  25%  MAC.  After  some  discussion,  consensus 
was  reached  on  fixing  the  CM  at  25%  MAC. 

E.2.4  Output  data  recording  differences 

Some  differences  between  the  simulation  tools  in  earlier  comparisons  were  not  indicative  of  differences  in 
dynamics  or  modeling  but  were  artifacts  of  the  data  output  (recording)  function.  The  following  aspects  of 
data  recording  contributed  to  apparent  initial  differences  between  the  simulations: 
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• Insufficient  output  precision. 

• A persistent  one  frame  lag  in  recording  an  output  variable. 

• Issues  with  capturing  the  correct  time-correlated  value  in  the  first  or  last  recording  frame. 

• Range  of  angle  quantities. 

• No  common  coordinate  system  among  the  data  files  for  the  state  being  compared. 


Insufficient  precision  in  output  fields.  The  initial  requirement  for  output  data  was  to  provide  at  least 
six  digits  of  precision.  Some  simulation  teams  configured  recording  output  for  six  significant  digits  and 
other  simulation  teams  configured  recording  output  for  six  decimal  places.  Six  decimal  places  would  not  be 
adequate  for  some  output  variables;  for  example,  atmospheric  density  in  slug/ft3  is  O(10-3)  and  would,  at 
most,  present  three  significant  digits  with  six  decimal  digit  output.  However,  even  six  significant  digits  would 
often  prove  inadequate  to  capture  differences  between  simulations  that  were  traceable  to  causes  other  than 
differences  in  integration  methods.  For  example,  capturing  longitude  to  six  significant  digits  at  the  Equator 
cannot  show  position  differences  smaller  than  20  ft  in  most  of  the  atmospheric  cases. 

The  orbital  cases  were  even  more  sensitive  to  differences  in  modeling  perturbations  and  these  differences  could 
only  be  uncovered  by  analyzing  data  with  at  least  10  to  12  significant  digits.  As  simulation  teams  increased 
the  significant  digits  of  displayed  for  data  fields,  a new  issue  emerged.  To  save  space,  some  simulations  were 
storing  variables  with  four-byte  data  types.  Increasing  output  precision  simply  added  random  numbers  or 
zeros  to  those  digits  of  precision  that  could  not  be  retained  in  four-byte  data  types.  In  other  words,  the 
accuracy  of  the  output  data  was  smaller  than  its  precision.  Those  simulations  then  increased  storage  to 
eight-byte  data  types.  It  took  a few  cycles  for  all  simulations  to  produce  output  with  sufficient  accuracy  and 
precision  to  meaningfully  analyze  the  data  sets  for  modeling  or  implementation  differences. 


Persistent  lag  in  output  variable.  The  output  variable  of  a simulation  would  occasionally  lag  in  value 
by  one  computational  frame  when  compared  to  the  other  simulations.  A recording  rate  was  agreed  to  for 
each  check-case.  However,  simulation  teams  were  free  to  run  at  whatever  rate  they  determined  produces 
adequate  results. 

In  most  cases,  simulation  tools  were  executed  at  a faster  rate  than  the  data  was  recorded.  Therefore, 
detecting  a lag  in  an  output  value  was  often  difficult.  In  some  cases,  the  simulation  team  would  record  at 
the  execution  rate  and  see  if  a better  match  were  obtained  if  the  data  were  shifted  forward  by  a frame.  In 
other  cases,  another  simulation  team  would  record  at  the  execution  rate  and  test  whether  a better  match 
was  obtained  using  a value  delayed  one  frame. 

Another  means  of  detecting  potential  lags  in  the  recording  was  to  estimate  the  time  history  of  next  com- 
putation frame  values  from  the  reported  time  history  of  the  values.  Estimation  techniques  included  linear 
interpolation,  integration  of  the  variables  reported  derivatives,  or  partial  application  of  kinematic  relation- 
ships using  output  variables  that  did  not  appear  to  lag  by  a computational  frame. 


Uncorrelated  values  in  the  first  or  last  recording  frame.  An  output  variable  in  one  simulation 
occasionally  exhibited  a sudden  decrease  in  difference  relative  to  other  simulations  from  the  first  to  second 
frame.  Similarly,  an  output  variable  in  one  simulation  sometimes  exhibited  a sudden  increase  in  difference 
relative  to  the  other  simulations  in  the  last  frame. 

There  were  a number  of  potential  causes  for  the  first  case.  The  output  variable  may  not  have  been  updated 
with  a complete  set  of  input  values  correlated  at  t = 0.  Alternatively,  the  recording  function  may  capture 
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the  output  variable  at  a point  in  the  execution  sequence  that  is  incomplete  prior  to  the  execution  of  first 
frame,  or  the  recording  function  may  capture  a value  in  the  first  frame  that  leads  the  other  simulations  by 
one  computational  frame  because  the  output  value  is  not  computed  prior  to  the  first  frame. 

For  the  case  where  differences  suddenly  change  in  the  last  frame,  the  recording  function  may  be  forced  to 
capture  a value  that  leads  or  lags  the  other  simulations  by  a computational  frame  because  the  simulation 
shutdown  changes  the  sequence  of  operations  in  the  last  frame.  It  is  also  possible  that  the  plotting  software 
causes  these  artifacts  when  processing  data  files  with  different  recording  rates  or  different  recording  lengths. 


Range  for  angles.  The  simulations  maintained  different  ranges  for  the  angle  outputs.  For  example,  initial 
comparisons  showed  three  different  ranges  for  yaw  angle  exhibited  by  the  simulations.  One  set  of  simulations 
used  the  range  [0,360),  another  set  used  (—180,180],  and  a third  set  used  [0,  inf). 

Furthermore,  when  a scenario  neared  the  wrap-around  point  for  the  range,  it  was  possible  for  two  simulations 
to  cross  the  wrap-around  point  at  different  but  adjacent  recording  frames;  this  would  produce  an  apparent 
difference  near  the  full  range  and  hide  the  real  angular  difference  between  the  simulations. 

Differences  in  angle  range  were  handled  during  comparison  plotting  by  reducing  all  simulation  data  to  the 
same  range  and  using  one  simulation  as  the  basis  of  comparison  rather  than  attempting  to  compute  an 
ensemble  average. 


No  common  coordinate  system  for  a quantity.  Sometimes,  there  was  no  common  coordinate  system 
among  the  simulation  data  files.  For  example,  in  the  atmospheric  cases,  output  data  files  presented  the 
gravitation  vector  in  body  coordinates,  NED  coordinates,  or  ECI  coordinates.  Some  simulation  teams  were 
able  to  implement  a new  coordinate  system  in  order  to  establish  commonality.  In  other  situations,  post- 
processing might  be  used  to  generate  a common  item  for  comparison.  In  the  example  of  the  gravitation 
vector,  the  early  atmospheric  cases  generated  no  north  or  east  components  of  gravitation.  Thus,  the  Down 
component  of  gravitation  was  compared  to  the  magnitude  of  the  gravitation  vector  in  simulations  using  body 
or  ECI  coordinates.  However,  this  post-processing  would  generate  apparent  differences  in  later  scenarios 
where  a north  component  of  gravitation  emerged. 

To  improve  comparisons,  the  post-processing  was  then  updated  to  compare  gravitation  magnitudes  across 
all  simulations. 


E.2.5  Timing  of  external  forces  and  torques 

Atmospheric  check-case  17  and  orbital  check-cases  6C,  6D,  and  9A  through  9D  specified  an  input  shaped 
like  a square  pulse  in  force  or  torque  with  a start  time  and  duration.  During  initial  comparisons,  there  was 
some  ambiguity  over  the  exact  times  at  which  the  leading-  and  trailing-edge  of  the  square  occurred.  Both 
the  leading-  and  trailing-edge  of  the  square  pulse  occurred  in-between  recording  steps  for  the  simulations. 
To  clarify  agreement  on  the  leading-  and  trailing-edge  of  the  pulse,  simulation  teams  exchanged  partial  runs 
where  the  recording  rate  was  increased  to  capture  the  exact  time  for  both  edges  of  the  square  pulse. 

E.3  Suggestions  for  future  work 

This  report  documents  the  results  of  a 6-DOF  flight  simulation  comparison  study  running  a specified  set 
of  models  and  flight  maneuvers  in  specified  check-cases.  This  effort  was  intended  to  aid  the  aerospace 
community  in  resolving  differences  in  its  simulation  tool-sets,  but  it  is  hoped  an  additional  benefit  will  be 


NESC  Document  No.:  NESC-RP-12-00770,  Volume  II 


© 

NASA  Engineering  and  Safety  Center 
Technical  Assessment  Report 

Document 

NESC-RP- 

12-00770 

Version: 

1.0 

Title: 

Check-cases  for  Verification  of  Six-Degree-of-Freedom  Flight 
Vehicle  Simulations  — Volume  II:  Appendices 

Page  #: 

607  of  609 

to  provide  confidence  in  other  industry-developed  simulation  tools  if  they  show  similar  results  for  the  same 
check-cases. 

Ongoing  work  is  to  resolve  as  many  differences  in  flight  simulation  tools  as  possible.  The  supersonic  maneu- 
vering flight  check-case  (case  14)  was  not  satisfactorily  completed;  although  three  simulation  tools  provided 
trajectories,  the  timing  and  amplitude  of  input  sequences  were  different  due  to  a change  in  specification 
that  occurred  mid- assessment.  An  additional  atmospheric  check-case  involving  a Apollo-like  capsule  during 
atmospheric  reentry  was  proposed,  but  was  not  evaluated  by  any  simulation  tool  due  to  resource  limitations. 

The  authors  welcome  participation  by  other  simulation  tool  developers  who  might  wish  to  perform  the  same 
simulated  flight  trajectory  comparisons. 
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